Tag Archives: Feedback and Evidence

Does Technology Improve Learning – No! A Keynote

I recently had the honor of keynoting at the Illinois Computing Educators (ICE) conference.

My message was that technology alone will not improve learning; only teachers improve learning. But technology can be wonderful tool for teachers and for students under the guidance of teachers.

Watch the keynote here. And related resources are down below.

 

If we want to leverage technology well for learning, then these are the components we should attention to:

  • Focus on Learning
  • Deliberate, Shared Leadership
  • Community Engagement
  • How You REALLY Protect Stuff
  • Support the Heck Out of Folks

Resources

Technology:

Learning:

Leadership:

Community Engagement:

Supporting Educators (Professional Development):

 

Positive Pressure & Support Part 2: Supervision

So, you’re waist deep in your school’s initiative. Maybe it’s improving learning by taking advantage of 1to1 tablets or laptops, or through Mass Customized Learning, or with a focus on student motivation and engagement.

And you are providing teachers with training and resources. And you are working to leverage Positive Pressure and Support to drive your initiative to a high level of implementation. You’ve taken the first step and set expectations with your staff. In general, your staff are working to put those into action.

And you’re ready to move your implementation to the next level. It’s time to focus on supervision.

Most educators really do work hard at trying to do a good job in all aspects, not just for the initiative, and that means that they are busy and have lots of (sometimes contradictory) priorities they are trying to address. Knowing what school leaders are keeping an eye on can help focus their efforts. Frankly, even the best teachers are more likely to address priorities that they know are being supervised. An expectation that is simply stated is not as likely to be implemented as one that is both stated and monitored. Think of the old assessment adage, “What gets measured gets done.”

Several strategies help leaders supervise for the implementation of their initiative.

Supervise: Check With Teachers
Periodically checking in with teachers can go a long way toward increasing implementation. Check their lesson plans. Are they clearly planning to use desired strategies as often as you’d like? You don’t necessarily have to have everyone turn in their plans weekly. Random spot checks can be powerful and not a time-sink for you. You can always increase the frequency of checks with teachers who need a little extra encouragement.

Alternately, give teachers a weekly survey. In Advantage 2014, our iPads in kindergarten initiative, we used a Google form to survey the teachers each week. They simply had to select drop down choices for each item, such as how many times this week did you use iPads in literacy centers? Or how often this week did you use iPads for individual student interventions? These survey questions came directly from our expectations for the program. We also included “what have been your successes?” and “what have been your challenges?” as open response questions in the survey. This has been an added bonus, because it provides invaluable information on when a teacher might be a resource to others and where teachers need additional (and timely!) support.

Supervise: Talk About Implementation at Staff Meetings
Take a little time at every staff meeting (or grade level meeting, or department meeting, etc.) to talk about the initiative. I like to make sure there is time for teachers to share what specific things they have done and what has gone well or what has been challenging. Sometimes I’ll use information I’ve gotten from the surveys to either offer a tip that might be a quick fix to a challenge, or to ask a teacher who has had a success to take 5-10 minutes to describe what they did, or to model a lesson.

It doesn’t hurt to review the specific expectations and even have a conversation about any of them that teachers want to talk about. Of course, people are people, so such open conversations about expectations, expectations that some might be struggling with, takes good facilitation skills (e.g. have you collaboratively set norms with your staff for discussions in staff meetings?).

(Note: if you want to be a leader for school change, one of the biggest favors you can do for yourself is to learn effective strategies for facilitating difficult conversations. No one really enjoys conflict or when emotions are running high, but, in the end, your colleagues will appreciate you’re working to deal with those situations is a respectful, safe way, rather than avoid them and brush them under the rug – or worse! Deal with them ineffectively to increase conflict and make emotions higher…)

It is clear that taking the time to talk about their strategies for implementing the initiative (and meeting expectations) will reinforce the expectations. And this strategy will tell the staff that this is important and we want to keep moving toward our vision.

But it is also a supervisory move. Who is sharing and who isn’t? What does what each teacher shares tell you about how they are doing with the initiative? Are they just “yes ma’am”-ing you, or are they really trying strategies (even if they aren’t being entirely successful yet)? Do their comments show depth (like they’re really trying and thinking about what they are trying), or are comments kind of superficial (like they want you to think they are trying)?

Supervise: Conduct Walk Throughs
“Walk throughs” can mean different things to different people, or in different contexts. Here, I mean frequent, brief classroom visits. It is helpful to use some short of checklist or form to collect a little data on observable instructional characteristics connected to your initiative and to your explicit expectations. So, in the context of Positive Pressure and Support, walk throughs are when you quietly drop into the room, watch, make a few marks on a form, smile at the teacher, and leave.

And I especially do not mean the classroom observations that are used for evaluation. Walk throughs work best when they are used as formative assessment (information to guide and inform your efforts to increase the level of implementation), rather than as evaluative data. Teachers will behave differently when they believe they are being evaluated, not simply observed or supported. The best walk through data (data that will help you increase the level of implementation of your initiative) comes when teachers feel safe when being observed.

In fact, if you are the one doing teacher appraisals and evaluations, you may not be the right person to do the walk throughs. If you are going to do these walk throughs, you may have to do some groundwork with your staff to help them understand the difference between this data and appraisal data, and reassure staff that this data will be used to help the school get better at the initiative, not for their evaluations. (Of course, it goes without saying that the quickest way to undermine your own initiative is to violate staff trust by using this walk through data for evaluations.)

Alternately, having teachers do walk throughs on each other can be a powerful strategy that produces added benefits. You can free staff to take a period every couple of weeks to do drop-in walk throughs of their peers. Not only do teachers often feel safer being observed by their peers, but teachers are often isolated from each other, and seeing other teachers teach can give the visiting teacher ideas for their own practice.

Observations forms should match your initiative’s goals and your expectatons. A quick google search will help you find samples, or you can create your own. For Advantage 2014, we created this walk through form for principals, connected directly to our expectations. When working with schools on using Meaningful Engaged Learning, I have used this walk through form that looks for low-impact and high-impact motivators. There is a wonderful online walk through service called iWalkThrough. It allows you to use a laptop, tablet, or smart phone to record your observable data using one of their pre-established observation forms.

Supervise: Talk About Walk Through and Level of Implementation Data
Clearly there is little “positive pressure” unless you use the data you have collected. How do you leverage that data, if you aren’t going to use it for evaluation? How can it be used to increase the level of implementation?

Start with tabulating data so that you can get a quick picture of where the staff is as a whole. One advantage of iWalkThrough is that it automatically does this for you (in fact, because everyone using iWalkThrough is using the same observation forms, you can even see how your school is doing against the agregate performance of all iWalkThrough users). Sharing this data at a staff meeting gives you the opportunity to have the staff comment on the school’s progress (including praise, and recognizing effort and progress), and even brainstorm how they might move to the next level. This is especially helpful as data is collected over time and the school can track its progress month to month, or term to term.

Tools like iWalkThrough will even allow you to use the data in interesting ways. In one staff meeting at a school I was working with, we called up the data and created a graph mapping “level of student engagement” onto “level of Blooms.” Wasn’t that telling! You can do similar kinds of investigations if you put your own data into a spreadsheet, but that’s a little more involved.

Tabulating individual teacher data will let you know where each staff member is, and provides the opportunity to have conversations with each teacher about their own progress and about setting individual goals (but I don’t recommend this unless you have been using the school data alone for a while and are starting to see progress). Having teachers examine their own level of implementation against the school’s agregate data can be a reality check. Sometimes, teachers who are struggling think everyone else is, too, and they believe they are doing just fine. But seeing that the school as a whole is ahead of them can lead them to ask what others are doing that they are not (if they feel safe and supported). Conversely, teachers who are way ahead of the school as a whole can shift from being frustrated that others aren’t further, to thinking about how they might support their colleagues.

 

Supervising is where you create the “positive pressure” to move your initiative to a higher level of implementation. Supervising helps provide your staff the feedback and evidence they need to continue to move toward the school’s vision. But keep in mind that it is “positive” pressure you’re looking for. Negative pressure is likely to take you in the other direction, toward a lower level of implementaiton. You need the pressure to help drive your initiative, but you need to be mindful of whether you are creating positive or negative pressure.

Other than the strategies described here, how else might you create positive pressure?

 

Confirmed: iPads Extend a Teacher’s Impact on Kindergarten Literacy

I’m excited! I’m REALLY excited!

Our “Phase I” research results are in…

iPads in Kindergarten

We (Auburn School Department) took a big risk last May when we started down the path to have the first 1to1 kindergarten learning with iPads initiative. We had confidence it would help us improve our literacy and math proficiency rates. One of our literacy specialists had used her own iPad with students to great success (one of the big reasons we moved forward). But there were also segments of the community that thought we were crazy.

Now we have pretty good evidence it works!

We did something not a lot of districts do: a randomized control trial. We randomly selected half our kindergarten classrooms to get iPads in September. The other half would use traditional methods until December, when they received their iPads. We used our regular kindergarten literacy screening tools (CPAA, Rigby, Observation Survey) for the pre-test and post-test. And across the board, the results were emerging positive for the iPad classrooms, with one area having statistical significance.

These results are a strong indication that the iPad and it’s apps extend the impact our teachers have on our students’ literacy development. We definitely need more research (and will be continuing the study through the year, including comparing this year’s results to past years), but these results should be more than enough evidence to address the community’s question, “How do we know this works?”

And I’m especially excited that we went all the way to the Gold Standard for education research: randomized control trials. That’s the level of research that can open doors to funding and to policy support.

Why do we think we got these results?

We asked our kindergarten teachers that question. Anyone walking by one of the classrooms can certainly see that student engagement and motivation is up when using the iPads. But our kindergarten teachers teased it out further. Because they are engaged, students are practicing longer. They are getting immediate feedback, so they are practicing better. Because we correlate our apps to our curriculum, they are practicing the right stuff. Because we select apps that won’t let students do things just any way, we know the students are practicing the right way. Because they are engaged, teachers are more free to work one on one with the students who need extra support at that moment.

We also believe we got the results we got because we have viewed this as an initiative with many moving parts that we are addressing systemically. A reporter asked me, how do you know how much of these results are the iPad, how much the professional development, and how much the apps. I responded that it is all those things together, on purpose. We are using a systemic approach that recognizes our success is dependent on, among other things, the technology, choosing apps wisely, training and supporting teachers in a breadth of literacy strategies (including applying the iPad), partnering with people and organizations that have expertise and resources they can share with us, and finding data where we can so we can focus on continuous improvement.

And we’re moving forward – with our research, with getting better at math and literacy development in kindergarten, with figuring out how to move this to the first grade.

So. We have what we were looking for:

Confirmation that our vision works.

It’s Your Turn:

What do you think the implications of our research are? What do our findings mean to you?