Alexandre has a nice blog post up about how pickle works. I honestly had never bothered to learn enough about pickle to know why pickle existed over marshal since everything pickle has to represent has to be doable in bytecode. But pickle is definitely simpler.
Full disclosure: Alexandre is my student for the Google Summer of Code this year.
