Learning, feedback, validation

Researchers say feedback should be timely in order to maximize effectiveness ((Research-Based Strategies: Providing Feedback)). Animal trainers understand this – clickers and treats are shared as close as possible to desired behavior. Software developers get it too; agile developers build, test & deploy in quick iterative cycles to figure out what works and what doesn’t.

As a student blogging my own learning experiences, I was reminded of the importance of feedback as validation this week through the very kind words of others around the interwebs. What’s triggering my Pavlovian response this week?

As a student, this external validation compliments internal motivation to continue learning. It also provides incentive to redesign my blog, since people might actually visit.

As a teacher, the past week’s article references suggest that I reflect on my own role as an assessor and agent of feedback. I’m sometimes slow to offer feedback, especially with multi-media projects. I pose questions and offer suggestions through-out the build process but don’t  assess final products in a reasonable amount of time. I can start today by recognizing each student contribution face-to-face.

If I impose any kind of deadline on a project, then the least I can do is give myself a deadline to return comments. Students learn through all senses – If I hope to influence student behavior, I must start by modeling positive habits.

 

Redefining data-driven

In Austin at SxSWedu, I was asked to participate in 2 concurrent sessions back-to-back. I’ve already blogged the first, called “TheirSpace: Educating Digitally Ethical Teens,” a reflective presentation of 5 years spent talking with middle school students about media, identity and youth.

The second session was a panel – and one of the most intense rooms I’ve ever been in at an educational conference. The topic was “Redefining Data-Driven” – what information is captured about students and how it is used. In the days before SxSWedu started, Pearson called the session one of “Four…SXSWedu Sessions You CANNOT Miss,” and Marisa at edGeeks.com kindly called us out in her article, “Top 10 Things I Can’t Wait For at SxSwedu.”

The session was packed: people sitting in the aisles & standing at the back of the room…at one point an usher was posted outside the room barring entrance. Attendees were a mix of educators, journalists, policy makers, statisticians and edtech entrepreneurs.

Within 10 minutes, people were deconstructing the stakeholders involved in the US current educational system. Within 25 minutes, audience members were volleying questions back and forth across the room. By the 45 minute mark, the room had backed all the way up to some fundamental questions that shape our beliefs about learning: can society agree upon common set of learning objectives, what does learning look like in the 21st century, how should data be used to maximize the benefit for students?

Description from the SxSWedu website:

Ever since NCLB cemented the idea of standardized testing as the holy grail of accountability, teachers have struggled to figure out how to leverage data to improve instruction in the classroom. The problem is twofold: First, test data is but one type of data that can help a teacher adapt instruction. Second, standardized test data is not available when the teacher needs it most, in real time. By the time teachers receive standardized test data, those students have moved on to the next grade. This talk will describe the varieties of data a teacher can capture in real time and offer a framework for ensuring that the data captured is meaningful and actionable for both teachers and students.

(more…)

Got verbs? Action words in the classroom

The following post was written for the Better.At blog and originally posted on March 2, 2012.

As the US Department of Education moves to rebrand No Child Left Behind and increase the significance of high-stakes testing, there is a counter-movement growing in the teaching work-force to provide relevant educational experiences that encourage students to do more than just memorize and recite facts.

blooms-taxonomy from techwithintent.com - created by Ash Bhoopathy of Better.At

National policy-level decisions are mobilizing teachers to speak up about what works (and what doesn’t work) in education:

  • active student engagement with content,
  • recognition of failure as a valid and essential component of learning,
  • teacher role as a facilitator & guide, not just a content-expert,
  • exposing the learning process as a fluid, sometime murky experience,
  • recognition that real-world experiences are often stickier than rote learning,
  • learning environments that reflect the complex and connected nature of our planet,
  • opportunities to practice soft-skills that aren’t necessarily quantifiable: compromise, active listening, synthesis, etc,
  • learning outcomes that aim for the higher order thinking skills identified in Bloom’s Taxonomy (see illustration).

 

Many schools are working to capture, re-create & scale these successes into a mission statement. Curriculum designers and Web 2.0 companies are using adjectives that reflect these best teaching practices in their marketing to teachers, families and students. As words such as “collaborative”, “creative” and “innovative” find their way into more and more written materials – from iPad apps to book lists – teachers should not lose sight of the day-to-day actions required on the path to these abstract descriptors.


TheirSpace: Educating Digitally Ethical Teens

Last week I was lucky enough to travel to SxSWedu, a vibrant collective of educators, administrators and edtech entrepreneurs in Austin, TX.

I gave a presentation called TheirSpace: Educating Digitally Ethical Teens, which was a reflection on 5 years of talking with middle schoolers about the intersection of media, identity and adolescence.

Slides from the hour-long experience are displayed below (rss/email viewers may need to visit the site to view):

Attendees were an enthusiastic group of educators who were interested in the topic. Several questions were posed throughout the session, and teachers used Twitter to share their own experiences and insights using the #theirspace hashtag. This information, along with resources for further learning (more…)

SxSWedu & SessionBombing

ses·sion·bomb·ing /ˈseSHən bom-ing/ – The practice of co-opting a presentation to pitch your own product.

SxSWedu is underway in Austin, Texas. Beautiful city, beautiful facility, friendly & professional organizers.

Having presented twice yesterday, I’m taken aback by the brazen SessionBombing that occurs. Vendors are shameless at using the relaxed format of the sessions to pose questions for which they believe their product is the answer.

I’m still trying to wrap my head around the demographics of attendees. Educators seem to be a mix of US higher education and regional K-12, and a large portion of the participants are representing web development teams, policy makers, or non-profits.

Many of the sessions have provocative titles that suggest attendees will gain knowledge in a subject, but so far the ones I’ve attended are thinly veiled product pitches. I might just be bad at picking sessions – I might just be naive.

I’m looking for more educator voices at the conference. I had a teacher actually thank me for entertaining questions during the TheirSpace: Educating Digitally Ethical Teens session. To me, inviting attendees into a conversation about effective classroom practice should be fundamental for any educational conference – not an anomaly.

Education & politics in Maine: is it the iPad?

Kudos to the Auburn School Department:

  • for searching out potential solutions to increase student literacy.
  • for designing a comprehensive roll-out plan & feedback-system beyond the purchase of iPads.
  • for sharing research and findings with the world.

 

Articles and blog posts around the web have headlines that suggest that the iPad is improving Maine’s literacy scores. These articles reference a Feb 15, 2012 Press Release from the Auburn School Department titled Kindergarten iPad Program sees Positive Results. This press release, in turn, references a Research Summary titled Emerging Results From The Nation’s First Kindergarten Implementation of iPad.

The Research Summary presents some early findings from a 1-to-1 Kindergarten iPad implementation. Out of 10 literacy tests, one shows a statistical increase in the literacy scores of iPad-equipped classes as compared to non-iPad-equipped classes. The press release, referencing the Research Summary, refers to initial findings as emerging positive and suggests that the 9 tests showing no statistical increase should be read as positive.

 

What changed?

Researchers note “improvement on the Hearing and Recording Sounds in Words (HRSIW) assessment, which measures a child’s level of phonemic awareness and ability to represent sounds with letters.”

This data suggests that there is a correlation between doing SOMETHING (providing iPads) is better than doing nothing (control group) for improving literacy scores. In this case, the ‘something’ is an expensive ongoing investment in hardware and technical support.

In his book “Too Simple to Fail: A Case for Educational Change,” Dr. Bausell’s research and study analysis concludes that increasing relevant time-on-task is the only way to increase learning. Applying Bausell’s conclusion to Auburn’s study, what other ways of increasing time-on-task can be tested to determine if the benefits are iPad-specific?

  • Watch 1 episode of Sesame Street per day for 9-weeks.
  • 10 minutes individual phonemic tutoring, 3 times a week for 9-weeks.
  • Use a document camera daily to project book pages during read-aloud and ask student to identify letters.

What didn’t change?

For the other 9 assessments completed in this 9-week study, there was no statistical significance reported. My understanding of “statistical significance” is that any results recorded are different enough as to suggest they weren’t caused by chance. Justin Reich reviews the study results and offers his perspective on the conclusions in his article, Are iPads making a significant difference? Findings from Auburn Maine.

iPad distribution was randomized, and I believe that this study was conducted in such a way that the only difference between the test group and the control group was device presence. The positive results referenced by Auburn’s press release all trend positive, but at this time the data doesn’t see enough of a change to consider it definitive. What other uncontrolled variables might be present in the study?

  • Does dropping $20,000+ worth of electronics into a classroom have an impact on teacher motivation?
  • Does providing teacher support to re-imagine curriculum have a positive impact on teacher-student engagement in the first 2 months of school?
  • Do shiny moving objects capture the attention of 5 year-olds?

 

What does it all mean?

Initial findings focus on literacy. If the iPad is to be an (r)evolutionary tool in education, subsequent Auburn studies should follow the positive trend lines and cause the iPad-using group of students to widen their achievement gap with the non-iPad group. It will be interesting to see the math data captured by Auburn and find out if similar gains are seen there.

Dr. Mike Muir (Auburn’s study lead) succinctly states a fact that researchers and district officials can likely agree on, “our study studied the impact of the iPad as we implemented them, which is to say, systemically, including professional development and other components.” I concur with Dr. Muir, and I’m sticking to my initial hypothesis from previous postings:

Ultimately, the ongoing success of an iPad deployment has very little to do with the iPad itself, and can be attributed to the concerted efforts from teachers, curriculum designers, IT support, administrators, parents and students. A common ground for all stakeholders is a position from which great things can happen.

As a classroom educator and 1-to-1 iPad manager, I can report that my students are engaged in more multi-media projects and are being challenged/assessed in more computer-centric ways than in the majority of non-1-to-1 learning environments I’ve witnessed. As a practitioner, I can also confirm that the instant-on feature of the iPad results in an average of 5-15 minutes of extra work time per period since there is no waiting for devices to fire up or log in. Multiply this by 3 classes a day and that is more than 75 minutes of extra time-on-task per week, or 45+ hours a year. I have to believe this time will have a positive impact on learning.

As someone interested in best classroom practice, research design and analysis, I have a few questions/concerns:

  • Will other districts use the press release as supporting documentation to make a major purchase and funnel funds away from professional development and towards device purchases? Study authors do not support this proposition.
  • If research ends up suggesting that a device can positively impact literacy, then many will assume more screen time will equal better results, increasing device-centric teaching.
  • Will outsourcing components of learning to Apps result in a decrease in instruction differentiation based on student needs?
  • Is there policy-level or political pressure on study authors & teachers to demonstrate success after such a large purchase? The current study shows some small correlations, for which there may be pressure to present findings as causation.
  • How can edtech journalists champion successes and report accurately without bashing those who are committing their lives to help children learn? I’m excited to learn more about this balance at the upcoming SXSWedu panel discussion, “Edtech Reporting: Why It Sucks and How to Fix It,” presented by Audrey Watters, Frank Catalano, Lisa Wolfe & Betsy Corcoran.

I’m cautious about the Auburn results but wish the best for Dr. Muir, his team, and the students.

Tips for cultivating a positive digital identity

Adolescents hear so many messages about what NOT to do online…let’s flip the script and provide some suggestions for cultivating a positive social network identity.

Some examples of healthy tips:

  • Upload photos of you cleaning storm drains
  • Start an online petition to clean up a park near your home
  • Join a Facebook group that supports healthy eating habits

Please contribute your own ideas via this form (original form available via this link):

What is your tip for cultivating a positive digital identity?
Please be specific, with directions if necessary.

Optional

If you’d like to be credited with your suggestions in the final slidedeck, please provide some information about yourself.












10 Steps to an Affordable Educational Technology Policy

Sam Gliksman recently posted a slide deck that should be required viewing for any school building a forward-thinking plan.

While the title hints at a mere 10 steps, this presentation alone could spark a full day conversation between admin, teachers, staff, students and families.

I reference Sam’s work on a weekly basis when consulting with school technology programs, and I’ve used a modified version of his iPad deployment survey in Seattle iPad roll-outs. Sam’s perspective spans the worlds of IT, EdTech and administration. To learn more about Sam, visit the iPadsInEducation Ning.

Detaching from EduCon without disengaging

Flying back to Seattle from a really intense weekend of professional development at EduCon.

All in all, the conference was energizing and fulfilling on both a personal and professional level. I had the opportunity to meet people who influence my teaching and philosophy face-to-face. The majority of sessions were designed to be interactive and there were multiple informal, open-invitation meetups every day. The deep-integration of social media was completely natural, with video-conferences, session streaming and heavy tweeting.

Beyond the excitement and enthusiasm of the event, I’m focused on two salient ideas:

 

  1. EduCon attendees are not special. Apologies to all of the incredible people present, but we aren’t smarter or more creative or gifted in some way that other educators are not. EduCon attendees are most alike in that they generally hold:
    • a willingness to believe that education is an evolutionary and revolutionary process, not a fixed discipline.
    • a recognition that a learning environment should reflect the individuals within it.
    • a certain amount of humility and vulnerability as they admit that they themselves are learners, sometimes learners without a clear vision of their destination.
  2. EduCon should not be a once-a-year mindset. EduCon is in many ways special, but it doesn’t have to be unique. The ideas and format, while masterfully orchestrated by the students and staff at the Science Leadership Academy, are replicable and adaptable. We have frameworks for optimal learning environments, those aren’t just for children – educators should model inquiry-driven learning in collaborative settings too.

This second point was the topic of an Encienda presentation ((Here are the slides for my presentation – they were designed to compliment my words, not substitute for them.

)) I gave at EduCon on Saturday.  Asked to participate about 90 minutes prior to the session, I scrambled a little to get my thoughts and slides in order. I was honored to be a part of the experience and the positive responses were much appreciated.

My plan is to carry forward these ideas and maintain a network of innovation that spreads through future professional development experiences and inspires other to push their own beliefs about learning environments. If you’d like to join me, feel free to accept the challenge and pledge publicly at http://www.flip-lab.com/challenge.

Apple’s e-textbook announcement critiqued

This morning Apple released an e-textbook authoring tool & distribution system, and in a single announcement may have shifted many of the purchasing conversations that occur annually at educational institutions.

On first glance, this seems to be a rebrand of the iTunes U bookstore focused on schools of all levels – an evolution of existing technology, not a revolution. iBookstore already allows authors to distribute books. The ‘new’ e-textbooks appear to be ePub3, a standard that already is in production and has the potential to work on more than just an iPad. Apple’s iWork Pages application already has the ability to “Export as an ePub”, although the new authoring tool should have a more robust feature set. Furthermore, an ePub can already be opened in iBooks without going through the iBookstore distribution channel, via email. However, Apple’s marketing strategy, as always, is fascinating and potentially extremely effective:

 

  • Allow consumers to assume hardware purchase as a logical step in an implementation plan, rather than advertise to that decision – By getting teachers, administrators, parents and students excited about the potential of using digital textbooks in the classroom, Apple brings its audience to vision. If people buy into the vision, then the purchasing decision to equip students with iPads (and teachers with laptops) is just a step on the path.
  • Focuses on action verbs – Apple’s marketing team has always focused on what people do with their products, rather than device specs. The vast majority of device buyers don’t know one processor from another and are interested in whether or not they can surf the web from their phone rather than what version of Android is installed. Engaged students (collaborating with each other and accessing dynamic content) are one of the cornerstones of successful education.
  • Convince administrators to reallocate scarce budgets – At a time of year where many schools are solidifying next year’s budgets, Apple has presented a neatly packaged authoring & delivery system for digital textbooks that may mean a cost savings in book purchases in exchange for an increase in technology purchases (namely iPads).
  • Align new offering with largest potential competition – Rather than battle traditional printed textbook publishers, Apple has convinced Pearson, McGraw-Hill, and Houghton to partner with the new Apple distribution system. These three companies represent 90% of the textbook industry. No doubt reminding these CEOs about Apple iTunes effect on the music industry was influential. It has not been announced yet how these existing publishers will leverage Apple’s distribution system.

 

This new authoring and distribution system for e-textbooks goes a long way towards providing students a more versatile classroom reference. However, it is still a one-way delivery system. As an educator, I can qualitatively estimate student engagement and use assessments to judge whether it has an impact on learning – this is certainly the hope outlined in Apple’s advertisement (embedded below).

As a content creator and possible e-textbook author, I’d really like this advancement to include two-way communication. I’d like to know which chapters students spend the most time with, where the most notes are taken, if there are sections that students skip, etc. There are already some social learning networks out there (I’m familiar with Better.At) that provide plan authors with feedback that allows for content adjustments based on data. Technology already allows us the ability to auto-collect and aggregate this data, and test scores are at least one step removed from the feedback cycle.

 

Critique aside, I’m excited to play around and see how I can use it in my own classrooms.