Friday, December 02, 2005

Open Standards

There is always talk about open source technologies and how they will become the Microsoft killers.  How Linux will ultimately defeat Windows in the desktop environment as people begin to get the open source concept, the skills develop and the ROI and TCO issues are fully fleshed out.  It may happen; it just isn’t going to happen anytime soon.

I think a better discussion is around open standards.  In the education world, there are many standards bodies that work diligently to create standards of interoperability, classification, taxonomy, etc.  SIF, SCORM, IMS, Dublin Core are examples of standards bodies that have made good progress and actually have fairly mature standards that are open to the general public.

While standards have had a slow go of it, especially in the U.S., recent events suggest that they may be gaining traction.  Language around SIF is being seen in many RFP’s issued by educational agencies.  The USDOE’s national technology plan even calls for it directly. Instructional management systems are aligning to SCORM and IMS as a method to classify and distribute content. Digital learning objects, just in their infancy, are beginning to see standards that are applicable in the Dublin Core and SCORM that make their use a practical reality.

Industry vendors are also showing some surprising moves. Microsoft recently capitulated and opened up its Office document formats.  Microsoft is also aligning its educational software to these recognized standards as well.  Independent vendors providing education solutions and products are jumping on the bandwagon as well.  All are good signs that we are moving towards an environment of a K-12 ecosystem or what many refer to as a services oriented architecture.

Let’s face it: There is no one vendor or system out there that has all of the best products or solutions for the education space.  It is a highly fractured marketplace with many niche vendors providing many different products and solutions that all fit different needs.  Some are open source, many are built on Microsoft technologies and there are some being built in the J2EE environments.  Different operating systems, different architectures and different communication systems all guarantee that we will likely never see true interoperability between vendor applications in my lifetime.

But we should be able to get everyone to agree on a set of standards that all products can adhere to for classification of education data points.  Why should we be able to do that?  It offers real benefits for both education clients and vendors.  It gives clients the ability to build an infrastructure around standards, not proprietary technologies.  It allows clients to choose products and solutions based on their merits, not their technology or fit with existing systems.

For vendors, the competition then focuses on the product or solution itself, not the technology.  The real competition becomes focused on the capabilities of the product, the ease of use, the fit to the needs of the industry, etc.  Vendors make better products and clients get more flexible service oriented architectures and they both win in the end.  An important point here is that the vendor with the best products wins.  When you implement standards, the technology platform becomes a consumer choice.  Who cares if it is open source, Microsoft, Linux or Unix?  It doesn’t matter because the technology uses the standards to talk to other technologies.  The clients will buy according to their needs, their skills and their budgets.  The real battle then comes down to who has the best product that most closely fits the client needs.

So how do we get open standards moving at an accelerated pace?  I don’t think that we can continue to rely on the process in place today. There needs to be some investment and direction from a larger body that can help propel the process forward.  I think that some steps have to be taken to set the stage.  Almost all states and districts are now incorporating curriculum standards into their educational processes.  These standards need to be merged together into a set of national curriculum standards that represent a challenging curriculum for students.

With a national set of standards, standards for the classification and sequencing of digital learning objects can be finalized, standards for the classification of instructional content can be finalized, standards for benchmark assessments can be finalized and a schema based on an open communication standard, such as XML, can be developed and adopted by all.  This isn’t going to happen in today’s environment without some assistance and intervention from national organizations.  ISTE, CoSN, SETDA, CCSSO, national education bodies and the USDOE are all going to have make a rallying cry and begin to demand of vendors that standards be developed and adhered to within their products.  We also will need investment in the form of grants.

Only then will we see progress being made that truly supports our most precious resource, children, and our economic future in the years ahead.

Thursday, October 13, 2005

Losing My Laptop and Returning Time to the Classroom

I work in technology, I thrive on technology and more importantly I depend on technology.  I recently had a hard drive crash on my laptop and lost my operating system.  I actually back things up, so I didn’t lose my important documents and items critical to my existence and work functions.

I tried to reinstall Windows but could never get it to boot up and had to get a new hard drive and Windows image.  While I was waiting on that to happen, I installed a Linux image that my company is developing.  With a little trial and error here and there, I managed to get the Linux image installed and up and running.  Everything worked OK for the most part, but I couldn’t get many of my critical needs satisfied for a variety of reasons.

I learned a couple of lessons during this time:

  1. Linux and Open Source are not ready for prime time.  By prime time, I mean the average Joe.

  2. For all of this talk about Windows and monopoly and poor product development, it functions like it is supposed to the majority of the time I am using it.  That is worth more money to me.

  3. There are times when I need to put away my technology for a little while and get back to old fashioned ways.

It is point #3 that I want to talk about.  I am in Education sales for the K-12 market.  I found out that I was not going to die without my laptop.  And then this morning, I read this article on Wired today: The Dark Underbelly of Technology.  Tony Long talks about how technology was supposed to make our lives easier, but instead it seems to make us work more.  Take me as an example of the ever connected, ever working person.  I have a Blackberry cell phone and PDA, I have a laptop with wireless, I have a Wi-Fi card for my laptop and I have a Bluetooth earpiece.  There isn’t anytime during the day that I can’t get connected to the Internet in one way or another.  There also isn’t anytime during the day that someone can’t get in touch with me. Having the earpiece allows me to work while doing other things, like washing dishes, and the mute is a powerful function.  I have washed a lot of clothes and done a great deal of cleaning house during conference calls.

Where I am heading with this is that technology is a tool, not a replacement.  It can’t replace good old fashioned teaching.  The greatest impact on student achievement occurs in the classroom. Technology purchases that apply to and/or affect teachers should fill these basic requisites:

  1. They should return time to the classroom by reducing administrative tasks and making a teacher’s life easier

  2. They should enable, enhance or assist the instructional process, not replace it or parts of it.

  3. Professional development must accompany the new technology to enable the teacher to fully use the technology to accomplish 1 and 2 above.

Don’t get squashed by the dark underbelly of technology.  Make sensible choices that support the classroom teacher and don’t buy the next generation product if it can’t demonstrate positive results that return time to the classroom and help teachers.

And every now and then, put down your technology and go the old fashioned way.  It can be refreshing and release creativity that was held back by dependency on technology…..

Monday, October 10, 2005

Can Data Warehouse be a COTS Solution?

Data-driven decision making has become quite the buzz word in education the past few years. What exactly is a data warehouse? Typically, a data warehouse is a central repository of data that enables longitudinal reporting across a time dimension. Such a repository would be able to answer a question like: "How are my students performing on the CRCT from year to year?" or "Are my district test scores increasing year to year for each of my demographic subgroups?"

Customized off the Shelf (COTS) solutions are just that: Software products that can be customized to meet a client's specific needs or unique characteristics. I don't think that anyone will argue that every district has specific names for things, specific measures of success and specific business rules around data. One thing I don't think that anyone will argue about either, is that for the most parts all districts use the same basic set of data to deliver required reporting to state and federal agencies.

For the longest time, vendors have approached education data warehouse efforts as custom engagements that require a different design every time. But is that really the case? Let's take the case of NCLB reporting as an example. All districts have to report from the same basic set of data to determine Adequate Yearly Progress (AYP). Districts are required to record and report the progress of different subgroups of students as defined by performance on certain high-stakes tests. This information must be reported at the school level since AYP is a school level measure.

If this is the case, for a specific test, can we not build a solution that uses a pre-defined set of data and deliver that solution to multiple districts? There is some customization that is necessary. Different states have different tests, so customization is necessary as you move from state to state, but that customization is minimal. Different states have a different AYP figure, some for a particular year of a range that must be achieved over a range of years, such as three. So there is another customization, but still we are using the same basic data set: Student, school and test data to deliver the required information.

Test vary greatly you say and this is not a trivial effort. Perhaps not trivial, but not complex either. Tests are primarily criterion reference or norm reference and the general structures are replicable from one test to another. AYP rules are vastly different and would require intense effort you say. Not true either I argue, because for all states there is a measure or a single data point for achievement for a single year or multiple years. There may be multiple data points within a range of years, but it is still a data point.

Granted, there are other customizations that have to occur, but I think that vendors can build and sell an entry level data warehouse solution that is low cost and delivers the functional reporting requirements that most districts have today with minimal customization. I would argue that there are several vendors who can deliver a near off the shelf package today, if districts would buy it. Would they? The fact that there is not a COTS solution out there today suggests that this idea may not be a good one. Or is that the vendors make more money delivering customized proprietary solutions that offer different values to different audiences? The real money is made off of customization. So why wouldn't you create a loss leader that fuels the appetite for information? Give them their basic reporting needs and then let them pay you for district specific reporting needs.

Many districts have reporting needs and wants far beyond the required reporting. Again, most of these reporting needs are dependent upon a set of data that all districts collect in their administrative systems. Vendors in the market have modeled and implemented other areas or reporting as well. All of the major vendors have deployed solutions that report on HR, Finance, Programs and Services, Food and Nutrition, etc. I would again argue that many of these could be transformed into COTS-like solutions with minimal effort.

And why would districts want to host and maintain their own solutions? Let vendors build an on-demand (to borrow IBM's terms) system that allows districts pay a per student or teacher fee to use. Total cost of ownership would be lower for most, if not all districts, and the level of service and availability would likely be better as well.

I am sure my argument has holes, but I think it also has merit. Poke some holes in it for me and let's figure how to deliver real value at a low cost to districts across America. Save them some money and redirect time and money to the classroom where the real impact on student achievement occurs.

Tuesday, September 27, 2005

Struggling High School Readers

In a meeting with a client of mine this past week, an interesting topic came up: The void in materials and content to support struggling high school readers. The issue appears to be that the content, while aligned to the reading level, is not aligned appropriately to the age level. So struggling high school readers are reading content aimed at middle school kids as an example.

Well, you can imagine that would probably not be very stimulating for the high schooler and a probable outcome would be a high level of disinterest and thus slower improvement. According to people I spoke with, there is a huge void that no one is filling for this particular problem.

As we further discussed this concept, another "want" that came out was an intuitive solution that could assess a student's mastery prior to delivering content to assist in the remediation effort. This could be based on a number of items, that could be called flags that the reading solution could recognize and then personalize the delivery of the content. My thought is that the flags would likely come from a formative assessment solution that was based on standards. The standards that were not mastered, could be the flags that the reading solution could recognize and use to personalize the content.

Such a situation would require a learning framework of applications that natively talked to each other. The reading solution would have to be able to access data from a formative assessment solution to personalize the reading content on the fly. As well, the formative assessment solution would have to talk to the student information system to get the most recent class rosters. Such a solution does not exist in totality yet, but there are several companies working to build these connected ERP systems specific to education.

As education moves forward, any such solution should be based on state, national and international standards, such as the specific state's standards, NCES, SCORM and the Dublin Core. This will allow other companies to build snap-in application that can complement such structures and provide specific functionality above and beyond what I am calling the education ERP. This is what I commonly refer to as Open Standards.

Social stigma came out as well during the conversation. It was very apparent that the students would need to have anytime anywhere access and anonymous access for the remediation to be successful. Points like this, highlight the difficult job educators face of truly delivering individualized education. The technology is available. It is up to educators to begin demanding this of their vendor solutions and searching out those vendors and technologies that can fundamentally support school improvement, not make it more difficult.

Wednesday, May 04, 2005

School Improvement and Technology

Where do I think technology fits? More on that in the next post.... (from the last blog)

I left the last blog taking about school improvement processes and some of the successes that were occurring. At both Brazosport ISD and Fontana USD, the improvement was remarkable. Remarkable from the standpoint of what they achieved in their mix of student populations. I think that both districts probably had very strong leadership and were able to foster the culture change that was necessary.

I read an article about the superintendent at Duvall County who is retiring. Duvall has been experiencing solid gains in student achievement, though they are experiencing some flat performance recently. The focus of the Superintendent, John Fryer, has been on two primary things: staff development and data-driven decision making.

I have long thought that using data to support strategic decision making is a good thing. But I have long worried that districts and vendors were not giving the required focus to professional development that helps teachers and administrators. By professional development, I mean helping district staff understand what the data means and how they can effectively use it to differentiate instructional planning and delivery.

But that is only a first step. Benjamin Bloom, Mastery of Learning, always said that all kids can learn, just on different time lines. Another item to add to that thought is in "different ways." This where technology steps into the improvement process. We use data to slice and dice and examine different groups of kids and their achievement or lack of achievement. But we are not there yet in taking the next step, which makes it very easy for teachers to quickly identify a student's learning style and align content to that style.

For districts employing a Mastery of Learning approach or an 8 Step Instructional Process approach, such an ability would be a very nice thing. I envision a teacher reviewing the results of formative assessments and linking immediately to content aligned to and in support of those standards. If a class is experiencing trouble for a specific standard, a teacher should be able to click a link in a report and immediately be taken to content that supports that standard. In a perfect world, that content would be categorized by learning style (audio, visual, textual, etc.) Content is king and those districts that effectively use content will succeed.

Technology and school improvement processes. The average superintendent tenure is about three years I believe. The recent successes in school improvement take twice that long. Where I think technology fits in is to accelerate that process. If we can effectively use technology to personalize education, I think we can dramatically speed up the school improvement process. How do we do that? By making sure that the technology is at the classroom level and is easy to use for teachers. Here is an example of my thinking:

A school district is implementing an improvement process aligned to Mastery of Learning. They develop instructional calendars that are aligned to standards. Teachers work together to develop instructional plans that will enable their students to master those standards. They deliver instruction and they frequently assess to ensure mastery of the standards. For those students who do not achieve mastery, there is remediation efforts and re-assessment. Or those who do, there is enrichment to challenge them further. Maintenance of mastery occurs throughout the cycle as students move towards the time when they take a high stakes assessment that will test their knowledge of the standards. Processes are monitored frequently and professional development is provided where needed. So what?

If we could use data analysis and link it immediately to content, that would be a good thing. After a teachers gives a three week assessment, whether by bubble card or on-line, he/she should have the ability to look at the data and immediately determine non-mastery of standards. Using existing technology, the teacher should simply be able to click and be taken to an instructional management system where relevant content aligned to the standard and to learning styles is displayed.

Prior to the school year, teachers should be able to view reports on their upcoming rosters of students that display historical results around mastery of standards. By grouping students with like weaknesses, and strengths, teachers should be able to easily access content from those reports and use it to differentiate instruction.

This use of technology should effectively target intervention and accelerate the school improvement process. If we can do that and reduce the improvement time to three years, we and extend the tenure of superintendents who will be successful over time.

And for those who say we are teaching to the test. If the standards are challenging and the test manages the mastery of those standards, what's wrong with that? More on aligned technology systems next time.

Thursday, April 28, 2005

Arnold's Initiative

In the May 2nd issue of Business Week, there is an article in the Education section about an initiative by Arnold Schwarzenegger to link teachers pay to test scores. The huge red flag that everyone should be concerned with, is the intent to link pay with test scores from standardized state tests. While this particular initiative appears to be ill-conceived and is facing great resistance from the American Federation of Teachers, the demands of teacher accountability and pay for performance is rising rapidly.

Recent pay-for-performance initiatives are showing early signs of success, such as the ProComp plan in Denver, CO. This joint initiative between Denver Public Schools and the Denver Classroom Teacher Association is an excellent start that contains multiple factors related to assessing teacher performance. For those of us who have been in the classroom, pay linked solely to test performance is a scary thing. We are all aware that multiple factors affect a child's outcomes, both in the classroom and on high stakes tests.

But let's also be realistic. Education has been sheltered from the demands of accountability for far too long. The USDOE always likes to show the graph that compares the amount of dollars invested in education to the reading on grade level indicators for fourth graders.


NAEP Reading Scores Compared to ESEA Funding

It is very depressing to think that over the course of about 25 years and nearly $20 billion invested, that only 20% of fourth graders, as measured by the NAEP exam, are reading on grade level. If you can't read, how can you learn? Seems pretty fundamental to me.

This brings me to where my interests are in education: School improvement processes supported and accelerated by smart technology that is used effectively. Before you can use the technology, you have to do the heavy lifting of process improvement.

PLAN ==> DO ==> CHECK==> ACT

The four fundamental pillars of Deming's Continuous Improvement methodology. These four words have gained importance as continuous improvement has gained ground in the education industry. Leading consultants such as Pat Davenport, Gerald Anderson and Larry Lezzotte have created school improvement processes that either are centered on or contain portions of Deming's methods. So what you say? The interesting thing here is that dramatic successes have been achieved using these processes. So what you say again? The other very interesting thing is that these processes are achieving large scale success in different situations and different districts.

This is exactly what Richard Elmore, Education Chair at Harvard, addresses in his book, "School Reform from the Inside Out." Large scale replication of proven school improvement processes has proven to be a daunting and elusive goal. But recent successes at Brazosport ISD, Fontana USD and others are showing that school improvement processes can be replicated at differing districts with different compositions and different settings.

Where do I think technology fits? More on that in the next post....