You are viewing a read-only archive of the Blogs.Harvard network. Learn more.

Big on Big Data

Of major interest in Educational Technology is Big Data, which is a rather all-encompassing term for the vast mountains of information that our computers are collecting and how we humans might take advantage of it. The 2014 NMC Horizon Report for Higher Education highlighted this interest, noting that the “Rise of Data-Driven Learning and Assessment” and “Learning Analytics”, both of which revolve around the anlysis of Big Data, are technological trends that may have profound impact on education as we know it. A primary goal of several MOOCs, including edX, HarvardX, and MITx, is to research the data they collect from thousands of world-wide participants. And here, at Harvard, a main objective of the new Teaching and Learning Technologies program is to research all the data our new Learning Management System and associated tools will provide. Finally, our own little group, the Academic Techngology Development team, is starting to research how we can best analyze the data our tools collect.

Who r u?The main drive behind this interest in Big Data–at least, in Educational Technology–is the belief that through analyzing all of this information, we can create a better teaching and learning experience for instructors and students. The idea goes something like this: Alice, a student at Wonderland University, takes a course on existentialism from the Caterpillar. As Alice completes her assessments, the results are stored online, and through careful analysis of these results, the Caterpillar is able to deduce which concepts Alice is having difficulty understanding, and in which conecpts she is excelling. The Caterpillar can then tailor Alice’s future work to her needs, thus creating a better learning experience for her.

That’s the simplified version of the tale; many other permutations exist. For example, the Caterpillar may recognize that another student, Tweedledee, excels in one area that his brother, Tweedledum, does not, and decides to pair the two up so that Tweedledee can help his sibling. Or, perhaps, the Caterpillar discovers that his students grasp the concepts of mushrooms better when he discusses the concepts of fungi first, and adjusts his future syllabi accordingly.

Regardless of the scenarios, the promises of Big Data rely on the firm belief that something meaningful exists somewhere in all of that information, and that if we extract that meaningful something, then we can do something meaningful with it. Sound a bit ethereal? It’s not, as commercial companies such as Amazon, Netflix, and Google have uncannily demonstrated with their search and recommendation enginees. And in regards to applying Big Data to education, there’s a large field of research going on, not to mention a growing field of application and practice.

Online Learning About Learning Online

As I continue to tentatively wade back into development waters, I’ve started taking advantage of the many online learning opportunities that are out there. The reasoning is two-fold: (1) The obvious reason is that I want to learn (or, as the case may be, re-learn) some new languages and frameworks, and (2) as someone who works as an educational technologist, I ought to be current on these online opportunities, anyways.

In particular, I’ve been refreshing myself on JavaScript, teaching myself Python, becoming more familiar with Joomla!, and I’m also interested in getting some game development underway with HTML5. For my refresher on JavaScript and my dive into Python, I’ve been using Codeacademy; for Joomla, I’ve been taking advantage of lynda.com; and for game development in HTML5, I attempted participating in a Udacity MOOC. I’ve summarized my (ongoing) experiences below:

Codeacademy

This is a fantastic (and free!) resource for both beginner and advanced programmers, though advanced programmers may find the hand-holding approach a tad slow. Clearly aimed at introducing the newbie into the world of programming, each course re-introduces the fundamentals (syntax, variable assignment, conditionals and control flow, functions, objects, etc.). Each course is divided into sections, and each section into a series of lessons. Lessons build upon themselves, as do sections, and most importantly, several sections are reserved for implementing a simple application based on the concepts learned (I especially enjoyed “Pyglatin:” implementing a pig latin generator in Python).

The interface consists of panel on the left that introduces a particular concept, and then instructs the user to write some code based on the concept. Therein lies the genius of Codeacademy–unlike a book, you are not only forced to read about a subject, you are forced to actually sit down and implement it before moving on. And so far, I’ve discovered their console works amazingly well at detecting errors, giving hints if things don’t go well, and just generally getting things right.

In essence, Codeacademy was designed to teach code and coding practices–nothing else. It does so with simplicity–no fancy videos or multimedia, just well-written text and a console–which is what coding should be all about. Currently it offers courses in JavaScript, Python, HTML/CSS, PHP, Ruby, and APIs. It also offers Codeacademy labs where you can experiment with some of the new languages that you have learned.

Lynda.com

The amount of subject matter on lynda.com is staggering. From project management to 3D modeling, lynda.com offers courses on just about any popular technical concept out there. I typed in “Joomla” and received no less than 13 tutorials (granted, only three pertained to the most recent version of the system). I’m about a quarter way through “Joomla! 3 Essentials” and thus far, my experience has been a positive one.

The course on Joomla! 3 takes what I consider to be the “traditional” approach to online learning: Divide a course into a series of sections, divide each section into a series of lessons, with each lesson consisting of a video and downloadable content to perform the described exercises. Like Codeacademy, lynda.com understands that for most users, learning is the equivalent of doing. This particular course hand-holds the user through downloading and installing Joomla on one’s laptop, then stepping through a series of exercises based on downloadable material. The course sometimes encourages “homework” in between its lessons–that is, if you don’t complete the exercises after a lesson has finished, the next lesson will be tougher, if not impossible, to follow.

The videos for this particular course are professional and well-paced, though, again, for advanced users, the hand-holding might be a tad slow. Nevertheless, with just a quarter of the course behind me, I feel confident enough to go into any Joomla! environment and be able to decipher the basic structure of the site.

Perhaps the only downside to lynda.com is that it’s not free. Although you can get buy with paying $25/month, you really need to download the exercise files to fully experience a course, which ups the price to about $40/month. I’m fortunate that my institution offers lynda.com as a perk; if your institution doesn’t, I strongly encourage you to encourage them to invest in it.

Udacity

I won’t dwell too much on my first experience with MOOCs; suffice to say, I wasn’t impressed. I eagerly signed up for “HTML5 Game Development” when it started being offered, but gave up after the first lesson or two.

Like most MOOCs that I have seen, the course was divided up into a series of lessons, each lesson a series of videos, with each video followed by a “quiz” that could be automatically graded. This is where everything fell apart. The quizzes expected code to be inputted (in this case, Ajax code), and this code would then be “graded” as either correct or incorrect. The problem is that the Udacity grading engine (or whatever they were using behind the scenes) wasn’t able to grasp the concept that with coding, “there is more than one way to do it”.  Although a user could enter code that gave the correct result, the engine seemed to require that the code follow an exact syntax. And in following the discussion forums of each quiz (and some of the apologetic emails I received from instructors), it was clear I wasn’t the only one having difficulties. As I said, I gave up after a bit. Perhaps I’ll return some day.

Maybe I chose the wrong course, or maybe I was wrong in choosing Udacity; regardless, the experience seemed less professional and less reliable than either Codeacadmy or lynda.com. Maybe it’s because MOOCs are in their infancy. . . or perhaps it’s because they’re being run by academics rather than solid business professionals. Regardless, if the experience I had is any indication of how MOOCs are, in general, being run, I don’t see them as viable competitors to other online learning platforms.

 

 

Posted in Development, Javascript, MOOCs, Online Learning, Python. Tags: , , , , , , . Comments Off on Online Learning About Learning Online »

More MOOCs in the News

Massive Open Online Classrooms (MOOCs) made headlines in the New York Times again. Harvard University’s own venture into MOOC-space, edX, is mentioned, along with the usual suspects, Coursesara and Udacity.

A couple highlights from the article:

  • The challenges inherit in widening a traditional classroom to a global audience are breathing new life into the art of teaching and learning. Professors are finding that they need to reshape and rethink their instructional approach when teaching tens of thousands of virtual students.
  • These challenges will be overcome with the help of the students themselves. For example, the crowd-sourcing of moderating discussion forums and of grading via peer-to-peer evaluation is becoming critical to running a MOOC.
  • Peer-to-peer evaluation of assignments, such as essays, is permitting the MOOC to go beyond computer science and engineering, which were suited to automated, computer grading. Humanities courses are starting to jump aboard.
  • There is, of course, still much to learn, especially about how well students learn in a MOOC. MOOC-space is young, wild, and untamed.
Posted in MOOCs. Tags: , , , . Comments Off on More MOOCs in the News »

Peer Review, Peer Grading

With all the talk of MOOCs (edX / Coursera), I’ve been very interested in finding more information on peer review. So I’ve been reading the studies that espouse the benefits of peer review in general.

Duke Chronicle: Peer grading experiment a success, professor says
Mostly older articles via google

And the pitfalls:
How accurate is peer grading?

A couple years ago I was put in charge of working with UCLA’s Calibrated Peer Review for Eric Mazur. He was really excited about it — I was less so. But my problem was I was looking at the application, not the concept. Just because an application is overdeveloped drivel doesn’t mean what they were trying to do isn’t awesome. I’m of the thinking they should have simplified it. That seems to be the case with just about everything I see. Applications shouldn’t be as complicated as they’re made. The problem is there are usually too many people involved in a project’s inception and everyone needs to put a piece of themselves into it. But I digress. edX will be great.

I don’t think Mazur used the CPR for more than 2 semesters. Probably because there was too much overhead and it wasn’t intuitive enough. But a poor implementation doesn’t mean a poor idea.

Or at least that’s my theory on this. I hadn’t seen any progress with online implementations of this, people haven’t been pushing this teaching technique yet and it’s disappointing (or telling).

Coursera is making a run at it now. That is encouraging. That means edX will probably follow suit with a similar implementation. And I’m planning a mild implementation with Quizmo.

Posted in ATG, Quizmo. Tags: , , , , , , . Comments Off on Peer Review, Peer Grading »

What edX isn’t

I’m not sure where this has come from, but most of the discussion about edX on the webs is discussing how it’s going to take over residential education. How you don’t need a college education anymore because edX is free.

Perhaps the misconception comes from the poorly titled nytimes article. The article gets things right, but the title is misleading.

#edx on twitter

edX is advertising itself as the biggest thing since white bread, but what are they actually saying about their service?

What is edX?

MITx and Harvardx courses will not be offered for credit at either university.

… such certificates would not be issued under the name of Harvard or MIT.

And that’s really the big deal, that’s supposedly the big step forward from opencourseware. But it doesn’t exist. So I guess the point is to market the edX name so its certificates can someday have perceived value, or maybe that policy will be changed; but for now, based on what they have released, people seem to be ill-informed.

In contrast, Coursera links the name of the providing university to the cert. But the cert is available only through Coursera and will be released upon user request similarly to the way a university will release records to an inquiring employer. Maybe edX will adopt the same methodology, only time will tell as edX is too immature to intelligently speculate over currently. There’s some mitx software that was probably not written with open source in mind and 3 guys in a dark room somewhere feverishly trying to produce something that doesn’t embarrass the Cambridge community before fall. I’m confident they’ll come out with something nice, the problem is Coursera has a head start, a larger staff, possibly less politicking (grass is greener), and they already have a very nice feel to their product.

edX presents a wonderful opportunity to find a solution for the quandary that has been plaguing the educational community for a while. i.e. how to best leverage the webs for education. Education online has been clumsy at best, and this is another attempt to capture what works best. That’s what I’m excited about, the research of the successes and failures of these online classes. And to get that research, maybe it’s best for people to have an overreaching idea of what edX is so more people are interested.. so on second thought, nevermind.

Posted in Uncategorized. Tags: , , , , . Comments Off on What edX isn’t »