Episode 123 Empowering Student Learning & Assessment: Embracing Inclusive Learning Outcomes in Higher Ed Part 1

Welcome to Digication
Scholars Conversations.

I'm your host, Kelly Driscoll.

In this episode, you'll hear part one of
my conversation with Abby Crew, Assistant

Dean of Academic Planning, Assessment
and Improvement, Curriculum Review, and

Innovation at Colorado Mountain College.

More links and information about today's
conversation can be found on Digication's

Twitter, Facebook, and Instagram.

Full episodes of Digication Scholars
Conversations can be found on

YouTube or your favorite podcast app.

Welcome to Digication
Scholars Conversations.

I'm your host, Kelly Driscoll.

And today I am so pleased
to introduce Abbey Crewe.

Abbey Crewe is Assistant Dean of
Academic Planning, Assessment and

Improvement at Colorado Mountain College
Curriculum Review and Innovation.

Welcome Abbey.

Thank you.

Did I get that all right?

You did.

You did.

It took me one year of reading my
email signatures to memorize my title.

Well, thank you so much
for joining me today.

Um, I thought it would be fun to just
kind of kick things off, um, for our

listeners and learning a little bit
about what your role at, uh, CMC entails.

Well, my eight word title, um,
has been tagged onto as well.

So I am also the project manager
for our COMPASS Initiative and our

COMPASS Initiative Digication is
our strategic alignment between

academic affairs and student affairs.

And what's really exciting about
Digication and our partnership, uh,

with Digication is that we were looking
at, uh, first year experience and

realized that we have 11 different
campuses, we're a dual mission

institution, a third of our scholars
are dual enrollment, uh, so they're high

school concurrent enrollment students.

About a third of our learners are also
multi lingual learners, so we were really

struggling to find a first year experience
that met everyone's needs because we

don't have a one size fits all clientele.

And so we couldn't.

Uh, craft a one size fits all
first year experience either.

Um, so Digication gave us this
opportunity to capture the CMC

experience through ePortfolio.

So we are weaving that into our holistic
advising efforts, um, and really helping

students see themselves within their
scholarship and see their journey.

Both within and beyond the classroom
into job placement and Digication has

been really influential in that endeavor.

Wonderful.

Thank you.

And I know your school is pretty
new in its use of ePortfolios.

Are you still kind of considering
where you are in kind of that pilot

phase or have you expanded from
that initial kind of endeavor?

Let us know kind of where, where your
school is in that implementation.

We are in year two of our pilot
program, and we were able to extend

the pilot another year because of
the Quora launch, and so we're really

excited to pilot the assessment on
the back end of the Quora build.

with our brand new Institutional
Student Learning Outcomes.

So our Student Learning Assessment
Committee, uh, will be able to utilize

the AAC& U rubrics that align with
our Institutional Student Learning

Outcomes as they apply to the student
artifacts within the ePortfolio.

So that's what we will be
piloting this year specifically.

Nice.

And I, I love having institutions that are
kind of newer in these ePortfolio pursuit.

Pursuits come and speak to us about the
experience because it's so fresh, kind

of where you are in the beginning stages.

And I would love to just hear a little bit
about, you know, how did this all begin?

What kind of spurred the interest?

I know your institution's been
working Really diligently and

incorporating more high impact
practices into various classrooms.

How did ePortfolio really
become part of the discussion?

It's a great question because our
journey began with the High Impact

Practice Institute with AAC& U.

And as I alluded to earlier, we went
in doubling down on our first year

experience as our high impact practice
and then quickly pivoted, um, to

ePortfolio to capture that CMC experience.

So, our journey began, uh, with high
impact practice investigation and the

ways in which ePortfolio can really
capture that for, Uh, the myriad,

uh, experiences from certificate
to bachelors that our students

pursue at Colorado Mountain College.

We have subsequently, uh, attended
the AAC& U ePortfolio Institute

that is a year long pursuit.

Uh, we also attended the ALHE assessment
conference last year where LaGuardia

Community College were celebrating their
work and, you know, all signs pointed to

Digication, so we had to give it a go.

Well, we always love to hear that,
but tell us a little bit about the

AAC&U ePortfolio Institute experience.

Um, because I know there, there,
there may be some listeners that

are taking part in it right now.

Um, there may be some listeners
that have been thinking about it.

And I think that there's probably some
listeners like, uh, yourselves that.

participated in it and are now
in this kind of pilot phase or

getting things off the ground.

So tell us a little bit about what that
experience was like for your institution.

So what's, what's remarkable is that
you get to ideate with colleagues

who are in the same morass.

And so I really appreciate AAC&U
creating the space for us all to explore.

And strive and fail and explore some more.

Um, and so we, we got, we were invited
to present at the AAEEBL Conference.

Yeah.

And part of that preparation
was creating a journey map.

And I was like, well, we
hadn't really done that much.

And then I went through the exercise
of actually creating this journey

map and was like, oh my gosh,
we have done so much in a year.

And this journey map has actually
been celebrated and shared.

At board of trustees meetings and
academic council and throughout the

institution because we have done a lot
of work in a short amount of time with

an expert coach who has also made a lot
of mistakes and we learned from those

and it sets us ahead five years and in
collaboration with other institutions.

Who have similar stumbling blocks, and so
we kind of pick each other up and say this

worked at our institution, this didn't
work, so don't try that, or maybe try

that, but no, this might be, you know, an
impediment that's coming, so we really,

we just, we get to collaborate and ideate
on Um, Innovative strategies that are

truly change makers in the institution
of higher ed and that's exciting.

It's, it's empowering and it's
energizing and sometimes change can

be defeating and we all know that.

So we get to pick each other back up.

Yeah.

And you're really, you know.

Starting to get this off off the
ground, I think at a time where a lot

of institutions would say, Oh, you
know, our faculty are just exhausted.

How could we ask them to do
something different right now?

So how do you feel like it's been
positioned in such a way, your

institution, where it does feel like
it's more of an exciting opportunity

for faculty versus something that
It's just kind of one more thing that

they have to learn in the midst of
everything else going on in their lives.

Sure.

And I think faculty fatigue and
initiative burnout and all the other,

um, COVID has changed everything.

Um, it's a coalition of the willing.

So certainly there is no top down mandate
that faculty need to embed ePortfolio.

Um, we were really actually hoping
that the change agents themselves were

students, uh, celebrating their work,
um, and championing this practice at CMC.

It's really a gift that we're able to
offer students, both in terms of the

artifact that they can take into their
job interviews, but also the folio

thinking that it cultivates in a scholar.

To be able to connect what they're
learning in a math class and

articulate in an interview how that
sets them apart as a candidate.

Um, so that folio
thinking really is a gift.

And, and so again, faculty
have the opportunity to opt in.

We embed a tutor in any class that has
Digication for some technical assistance.

We actually have some student
scholars who are going to help us

as well, uh, student work study.

Uh, we have, last year was our first, our
inaugural student symposium to showcase

the work of students in ePortfolio
and that was remarkably well received.

Um, and finally we, we started the change
making through a four question, short

form reflective assessment practice that
asks our faculty to connect, um, what

they are, learn, what they're seeing
from their student artifacts, how they

connect to our institutional student
learning outcomes, and then reflecting

on how successful or not the case may
be and what supports they may need.

So we've.

We've had a couple of different
nodal points in this culture shift,

beginning with the four question short
form, kind of moving away from box

checking assessment to more authentic
assessment, and then connecting our new

institutional student learning outcomes.

to that authentic assessment
through ePortfolio.

So it's kind of like win, win, win.

We also have holistic advisors
who are championing this work.

Um, they, we can invite students to, um,
share who they are, why they're coming

to our institution, uh, what they hope
to get out of our institution prior to

even meeting, uh, an advisor and then
reflecting on the work that they were able

to demonstrate in their first semester.

Um, and then in subsequent semesters
in this e portfolio, this kind of

living transcript, if you will.

Oh, I love this.

And I hope some folks that might be
considering doing a pilot are madly

taking some notes on this because you've
clearly learned some really wonderful.

Best practices, you know, from having
it something where faculty members can

opt in versus it being something that's
mandated or top down, having tutors

that are inserted into the classrooms
already that just automatically

removes hurdles for faculty members
that may not feel like they're ready

to demonstrate the actual technology,
the use of the student mentor...

All of this is just, um, clearly
been beneficial for your students.

I mean, when you look at the quality
of the ePortfolios that are already

starting to be created two years
in at your institution, um, you can

tell that there you've got real.

faculty engagement and
commitment to, to the cause.

So thank you for, for sharing that.

Um, as the faculty members are kind
of opting into this experience,

what kind of resources are they
given to kind of prepare for

integrating this type of pedagogy
or technology into their practice.

I love that you started with some
reflective questions that they're

responding to because it sounds like
in terms of You know, assessment

and maybe choosing what kinds of
artifacts or student experiences their

students might add to the portfolio.

They're starting with something that,
you know, they're already doing, right?

They're doing the work in
their classrooms already.

It's just about capturing that.

How do you kind of take them from
those initial reflective questions

to then kind of putting it into
that day to day practice that

they're having in their classroom?

We have a number of different resources.

Um, so we have, I was like a
traveling library whenever I was

going to the different campuses and
I was like, we have all these books.

Um, so we have that.

I also have a Canvas page that I can add.

So we use Canvas as our
learning management system.

And I have added faculty
to that Canvas page.

Um, and so they have access to all of
the resources that I have created, and

those resources include, uh, onboarding
checklists, like, you know, email the

serve our learning management systems
specialist to have Digication added to

the tab, so it's single sign on, and,
you know, then embed the tutor, and, you

know, step by step instructions there.

I've also actually, I, I added a
transparency in teaching and learning

assignment for Digication that I
shared and I just worked on one

for the advisors actually as well.

So, um, uh, making accessible all of
the resources that have been created

so faculty can not start from scratch
but kind of ideate from what is

already in existence and just being
really intentional about connecting.

Like you said, what's already happening
in our classroom with our institutional

student learning outcomes, which I will
also add a line with our, um, Gen Ed

core curriculum, and those outcomes
come straight down from, uh, the

Community Colleges of Colorado system
that we, um, adhere to those agreements.

And so those Gen Ed outcomes.

are embedded in our institutional
student learning outcomes.

So it's all, like, very
intentionally nested.

So it's not additive, it's embedded.

And our job is to make, uh, transparent
what all students are learning when

they create a final project, right?

Like, that's, that's what we're doing.

So...

I have transparency in teaching and
learning, um, frameworks for the students,

but I'm doing a lot of that for our
faculty as well, connecting those dots.

Okay, great.

And I was curious, so from the, maybe
the initial goals that you had when

you were starting the pilot, what
Some of those might've been, and with

this next, you know, phase that you're
in, how have those evolved at all?

Or what maybe are some new goals now that
you've gotten to the place where you are?

Great question.

I think that we started at the course
level, uh, with our goals, and that was

just to get the pilot off the ground.

And I think our Our new goals are to
move from course level, we have some

programs that are super excited, uh, and
you probably saw some of those artifacts.

Uh, our outdoor leadership
students are taking selfies of

themselves hanging off mountains.

And they're really excited about it.

Um, and again, this is program level
assessment and the faculty are equally

excited about, um, you know, iterating
what that assessment, um, cycle looks

like and leveraging digication here.

Um, to the institutional level assessment.

So that I think is what we're really
focusing on in this, uh, second

year pilot, uh, moving from course
level to program to institution.

Yeah.

And I also noticed, you know, and
looking some at looking at some of the

student e portfolios in preparation
for our, our conversation today, that

there's a number of really wonderful
ePortfolios that are being created in.

More STEM oriented disciplines.

And I know sometimes in conversations
with institutions, you know, we'll

hear from, um, you know, maybe the
humanities, liberal arts, writing

programs that immediately see a
good fit for ePortfolios, but.

There's sometimes other disciplines
that feel like they don't have

a good fit for any reason.

And it seems like at your institution
that those that are in STEM

related kinds of fields and study
have just really grasped this.

Has there been anything about your
conversation with faculty members

in those disciplines that you
feel like may have shaped that?

Or is it just the culture of the
institution that just seems so

prime for this kind of pedagogy?

It's certainly faculty driven.

I will say our program director for
ecosystem science and stewardship

program is of Faculty champion
in ePortfolio, and she's really

driven the portfolio engagement.

Um, I think probably those
genetic students that you were

seeing, uh, in that project.

And our outdoor leadership studies
faculty are also really excited.

And, and it speaks.

I had a lot of many conversations with our
program director for outdoor leadership.

And he just shared, like, how an
ePortfolio speaks to his students.

They don't want to write a paper
about, you know, whatever they

were doing in the wilderness.

They want to take a picture of themselves.

And then they want to say,
you know, in a caption.

The cool stuff that they were
doing, like that just speaks to,

to their, um, heart and mind.

Yeah.

More.

And so it's really exciting
to be able to, to capture this

learning in a, um, multimodal way.

Yeah.

Yeah.

They wanna be outside.

Mm-Hmm.

they wanna be in the field
and, you know, really capturing

those things in, in the moment.

So, uh, that makes a lot of sense.

So, uh, for those listening, I warned
Abby that I did spend some time looking

at her own personal portfolio, uh, before
hopping on, uh, this podcast with me.

And there was an area
of the portfolio that I.

I really, I mean, I enjoyed reading the
whole thing, but I did want to highlight

some of the goals that you outlined there.

You're probably, you know, trying to
think what you said there, but, um,

you said, uh, that your goal is to
ensure higher education is welcoming

and equitable for all students and that
you're striving to inspire innovation

and passion for learning and improvement
among your colleagues and students.

And I was wondering if you could maybe
elaborate on that a little bit and talk

more about, because you're doing so
many things at the college right now.

Um, you know, you know, from looking
at your portfolio and looking

at all of the things that you're
doing, I get a sense of this.

Kind of incredible passion that you
have for education and also for your

students and their futures and I would
love to hear a little bit about how some

of the things that you're doing at the
college are kind of meeting those goals

or you feel like you're helping you
start to get to achieving those goals.

I had 17 eager learners in my
sociology of diversity class

yesterday and it was energizing.

Um, so it was our first class of the
fall semester, so that was exciting.

Um, and so I think how I'm, I'm
really a champion for high impact

practices across the institution and,
and being able to move the needle

there, uh, has been very meaningful.

We have.

We know that high impact practices work.

We also know that they work at CMC, and
that's what's really exciting for us.

We have some robust internal
data about increased persistence

rates for our students who are
exposed to high impact practices.

Um, so Making sure that faculty
are feeling supported, uh, that

they have the information that they
need, that they have the support

to embed a high impact practice in
their class is really important.

And the more that we're able to
champion this work and celebrate

this work and support this work.

The more our students thrive, and like,
that's what's so very important for me.

The other kind of few fire that fuels my
belly is, um, around the institutional

student learning outcomes that we, Just
updated, uh, and, and really making

relevant and transparent the, what we
call outcomes, competencies, and skills

that our students get from certificate
programs to bachelor's programs.

So, we don't have a distinction
at our institution from career

and technical education, are only
expected to demonstrate hands on

skills in our four year bachelor's
programs engaging critical thinking.

Like, we don't believe in that.

We believe that every learner at
Colorado Mountain College can demonstrate

knowledge, involvement, and application
upon graduation from any program.

And I think that that really kind
of democratizes higher education.

It also makes relevant.

higher education from our welders to
our bachelors in sustainability and

more kind of theoretical programs.

And, and it makes for a workforce
that has skills for the future that I

really think are imperative, um, from
critical thinking to oral communication.

to being able to work
with a diverse population.

And so, um, you know, from the 17 students
in my class to the faculty champions

to the systems in place, you know, we
kind of can scale out how impactful

higher education is and how important.

The work that we are doing and the
articulation of that work we are doing,

um, keeps me coming back every day.

I love it.

And it seems like whenever you're
kind of setting out to do something

that you have a real, um, kind of mind
for, and you know, I'm sure this is in

collaboration with others often as well,
but a real mind for kind of developing.

Um, kind of a scaffold or a very clear
kind of strategic plan for, you know, step

by step, you know, what various stages
are and how they can happen and what the

various goals are at each of those stages.

Stages.

And I enjoyed seeing some of the
presentations that you shared within

your personal ePortfolio that were
housed under a particular tab called

Knowledge, Involvement, and Application.

And it sounds like that is a
kind of common language that's

used throughout the institution.

And are those Knowledge, Involvement,
and Application kind of categories,

something that students are working
towards demonstrating as well?

Yes, those are our institutional
student learning outcomes.

And then embedded within those
outcomes are competencies and skills

and then the AAC& U dimensions
that we use to measure them.

So being consistent with those outcomes,
um, we even had a conversation about

our Employee evaluations aligning with
knowledge involvement in applications,

so it's just woven into the fabric of
what we do, um, and not an external box

to check assessment, which is kind of
historically what it had been, um, and I

do have an amazing team, including a new,
uh, assessment director, which really, uh,

we collaborated to, to drive a lot of this
change that we're seeing in action now.

Wonderful.

And I had a question for you too.

So I know many institutions kind of
wrestle with, um, you know, how, how

structured the, maybe the prompts or
templates that students are given need

to be in order for them to kind of
be able to see demonstration of their

Um, Outcomes in, in various courses or
learning experiences that they've had.

And how does, um, you know, how are
some of your kind of champion faculty

members there approaching that?

Have you seen them kind of try some?

Different, different structures or
approaches to kind of pulling that

information out of their students
and what that process has been like.

Yes, students always want a model.

And so many of our faculty champions
have gone in and made their own e

portfolio to share a model of what
this can look like and also to.

sort of stumble through the
technology and learn a new platform.

Uh, there's always a learning curve there.

So, um, that has certainly driven
a lot of this work as well.

That's great.

So, it sounds like, um, when they
approach it with their students,

they've, they've got some personal
knowledge of the, of the platform.

Um, you mentioned that they've
got tutors that come in and may

be available to provide some
initial training for the students.

How are the students then supported when
they start creating their own ePortfolios?

Is it something that faculty
are really doing within there?

Classrooms.

Are there other kinds of resources?

Other than the embedded tutors, we
don't have a ton of other resources.

I'm hoping that our student, uh,
employees actually will create some

videos, some how to prompts, um,
and tutorials for the students.

Right now, our prompts are very open
ended, um, upload an artifact of your

work that demonstrates an alignment,
or demonstrates a dimension, um, and a

competency, and articulate how and why
that exists, and, and that's the extent

of our instruction right now, so, so
what is consistent are the outcomes,

uh, the competencies and the skills, and
then, and The instructions are really

quite open ended and we'll see how
that goes and so far so good Certainly

we can improve and iterate with each
Uh, student feedback we get as well.

Yeah.

Well, and I was going to say too, so
far so good because it seems like the

students have been able to embrace that
kind of open ended question and approach

that and respond in very creative.

Ways, um, they're all choosing very
different types of artifacts and

presenting it in different ways.

They're beautifully designed ePortfolios
the ones that I saw it included a lot of

media and Alongside the reflections that
they were writing towards the outcomes.

So they seem quite quite
comfortable in that environment.

And I know in your role that a lot of
your, um, kinds of focus, and maybe

this goes back to some of your early,
um, kind of studies in, um, gender

politics and gender studies, that there
seems to be this thread of interest.

And it's something that's very near
and dear to our hearts at Digication

too, around, you know, this kind of.

Kind of theme around belonging for the
students and finding their place within

the kind of institutional fabric, finding
their community at the same time that

they're starting to discover who they are.

And, um, learn about, you know,
all of their strengths and

skills and growth along the way.

Um, I was curious in, in the work
that you do, are there conversations

about using the ePortfolios?

In, in that way, um, you
know, how are they maybe being

coached or guided in that?

Yes, you know, we're interested in
seeing your demonstration of learning

outcomes, but, you know, how might this
be something that's of value to them,

you know, beyond demonstrating that at
an institutional level, how might it

really benefit them as an individual?

Yeah, we share with students that they
can, it's like a living transcript

and so they are able to take who
they are, how they're growing, what

they're working on and bring it
home and share with their family.

Um, and that's really important.

And also in, as a job placement, um,
skill and artifact that they can bring

in, um, and link on their profile and
then share with potential employers too.

So certainly beyond the
realm of the classroom.

When you were talking, I was
also thinking about how we really

emphasize, um, equity in assessment.

And so our multimodal authentic assessment
is imperative in a classroom where

the written word is not the only way.

To demonstrate an understanding
or kind of Freirian banking model,

like, we don't believe in that.

It does not resonate with our learners.

We're trying to, in, in some spaces,
decolonize, um, higher ed, and so I

think Digication give us a, a platform
to do that and to celebrate that and to

enhance many ways of knowing and being,
and especially at a institution with a

third of our population as multilingual
learners, to allow our, our students to,

to think in their native language and to
celebrate and ideate and demonstrate their

understanding in their native language.

Digication can do that.

And it's, it's really remarkable.

We're grateful for that.

Yeah.

Yeah.

Can you think of some examples
where you've kind of seen that come

to light in some of the student
portfolios that have been created?

We tried really hard with some
of our, um, ESL instructors to

integrate, uh, the ePortfolio.

And it was not as successful.

And actually, we've had some conversations
about offering instructions in Spanish.

And I think that would go a long way.

So when that happens, let us know.

Cause we really will be
early adopters there.

Um, so Jeff and I've talked about that.

Good, good.

Um, that would, that would.

Go really far in helping, um, celebrate
and champion the work of our multilingual

learners in an e portfolio and Right
now, some of our earlier classes, it,

the technology feels a little daunting,
and in our later classes, our students,

um, can celebrate their, their myriad,
um, identities in their ePortfolio.

But, you know, there's, there's
some, some technology navigation

that is required as well.

This concludes part one
of our conversation.

To hear part two, be sure to
subscribe to Digication Scholars

Conversations on YouTube, iTunes,
Spotify, or your favorite podcast app.

Digication Scholars Conversations
is brought to you by Digication,

a technology platform powering the
most innovative ePortfolio programs

in K 12 and higher education.

Our website can be
found at digication.com.

If you enjoyed today's
conversation, please like,

subscribe, and share with a friend.

Thanks for tuning in!

© 2020 Digication, Inc.