{"id":820,"date":"2010-10-24T23:58:48","date_gmt":"2010-10-24T14:58:48","guid":{"rendered":"http:\/\/peta.okechan.net\/blog\/?p=820"},"modified":"2010-10-24T23:58:48","modified_gmt":"2010-10-24T14:58:48","slug":"json-vs-pickle","status":"publish","type":"post","link":"https:\/\/peta.okechan.net\/blog\/archives\/820","title":{"rendered":"JSON vs pickle"},"content":{"rendered":"

\u6700\u8fd1\u3088\u304f\u8907\u96d1\u306a\u30aa\u30d6\u30b8\u30a7\u30af\u30c8\u306e\u4fdd\u5b58\u306e\u305f\u3081\u306bJSON\u3092\u4f7f\u3063\u3066\u3044\u307e\u3059\u3002
\n\u4eba\u9593\u306b\u3082\u8aad\u307f\u3084\u3059\u3044\u306e\u3067\u30c6\u30b9\u30c8\u3084\u30c7\u30d0\u30c3\u30b0\u306b\u4fbf\u5229\u3067\u3059\u3002<\/p>\n

\u3057\u304b\u3057Web\u30b5\u30fc\u30d3\u30b9\u7b49\u3067\u4f7f\u3046\u3068\u306a\u308b\u3068\u4f7f\u3044\u65b9\u306b\u3082\u3088\u308a\u307e\u3059\u304c\u3001\u7269\u51c4\u3044\u56de\u6570\u30aa\u30d6\u30b8\u30a7\u30af\u30c8\u2192JSON\u3068\u304bJSON\u2192\u30aa\u30d6\u30b8\u30a7\u30af\u30c8\u3068\u304b\u306e\u5909\u63db\u304c\u884c\u308f\u308c\u308b\u4e8b\u306b\u306a\u308a\u307e\u3059\u3002
\nJSON\u3088\u308a\u3082\u8aad\u307f\u3065\u3089\u304f\u306a\u308a\u307e\u3059\u304c\u3001\u5c02\u7528\u306e\u30d0\u30a4\u30ca\u30ea\u30c7\u30fc\u30bf\u3092\u6271\u3046pickle\u306a\u3089\u3082\u3063\u3068\u901f\u3044\u3093\u3058\u3083\u306a\u3044\u304b\uff1f\u3068\u3044\u3046\u3053\u3068\u3067\u8abf\u3079\u3066\u307f\u307e\u3057\u305f\u3002<\/p>\n

\u4ee5\u4e0b\u3001\u30c6\u30b9\u30c8\u30b3\u30fc\u30c9\u3002<\/p>\n

\r\nimport timeit\r\nimport json\r\nimport pickle\r\nimport cPickle\r\n\r\nsource_data = dict(id = 256, title = u'Test title.', tags = ('test', 'other', 'html'), published = True, comments = [])\r\n\r\nrepeat = 3\r\nloop = 100000\r\n\r\ndef to_json(data):\r\n\treturn json.dumps(data)\r\n\r\ndef from_json(data):\r\n\treturn json.loads(data)\r\n\r\ndef to_pickle(data):\r\n\treturn pickle.dumps(data, protocol = 2)\r\n\r\ndef from_pickle(data):\r\n\treturn pickle.loads(data)\r\n\r\ndef to_cPickle(data):\r\n\treturn cPickle.dumps(data, protocol = 2)\r\n\r\ndef from_cPickle(data):\r\n\treturn cPickle.loads(data)\r\n\r\nprint 'to_json'\r\nt = timeit.Timer('to_json(source_data)', 'from __main__ import to_json, source_data')\r\nprint min(t.repeat(repeat, loop))\r\nprint ''\r\n\r\nprint 'to_pickle'\r\nt = timeit.Timer('to_pickle(source_data)', 'from __main__ import to_pickle, source_data')\r\nprint min(t.repeat(repeat, loop))\r\nprint ''\r\n\r\nprint 'to_cPickle'\r\nt = timeit.Timer('to_cPickle(source_data)', 'from __main__ import to_cPickle, source_data')\r\nprint min(t.repeat(repeat, loop))\r\nprint ''\r\n\r\nprint 'from_json'\r\njson_data = to_json(source_data)\r\nt = timeit.Timer('from_json(json_data)', 'from __main__ import from_json, json_data')\r\nprint min(t.repeat(repeat, loop))\r\nprint ''\r\n\r\nprint 'from_pickle'\r\npickle_data = to_pickle(source_data)\r\nt = timeit.Timer('from_pickle(pickle_data)', 'from __main__ import from_pickle, pickle_data')\r\nprint min(t.repeat(repeat, loop))\r\nprint ''\r\n\r\nprint 'from_cPickle'\r\ncPickle_data = to_cPickle(source_data)\r\nt = timeit.Timer('from_cPickle(cPickle_data)', 'from __main__ import from_cPickle, cPickle_data')\r\nprint min(t.repeat(repeat, loop))\r\nprint ''\r\n<\/pre>\n
\u5b9f\u884c\u7d50\u679c\uff08Python2.7\u4f7f\u7528\uff09<\/p>\n
\r\nto_json\r\n1.91382908821\r\n\r\nto_pickle\r\n16.7020881176\r\n\r\nto_cPickle\r\n0.530957937241\r\n\r\nfrom_json\r\n2.18486499786\r\n\r\nfrom_pickle\r\n9.6311609745\r\n\r\nfrom_cPickle\r\n0.661497116089\r\n<\/pre>\n
pickle\u9045\u3044\u3067\u3059\u3002
\n\u3068\u3044\u3046\u304bjson\u901f\u3044\u3067\u3059\u3002
\ncPickle\u3068\u6bd4\u3079\u3066\u3053\u306e\u901f\u5ea6\u5dee\u306a\u3089\u3001\u81ea\u5206\u306e\u5178\u578b\u7684\u306a\u4f5c\u6210\u30d1\u30bf\u30fc\u30f3\u3060\u3068\u30c7\u30d0\u30c3\u30b0\u306e\u3057\u3084\u3059\u3055\u3092\u8003\u3048\u3066\u3068\u308a\u3042\u3048\u305ajson\u3067\u3059\u306d\u3002
\n\u901f\u5ea6\u306b\u6211\u6162\u306a\u3089\u306a\u304f\u306a\u3063\u305f\u3089cPickle\u3002<\/p>\n
\u3057\u304b\u3057\u305d\u308c\u305e\u308c\u30e1\u30ea\u30c3\u30c8\u30fb\u30c7\u30e1\u30ea\u30c3\u30c8\u3042\u308a\u307e\u3059\u306e\u3067\u4f7f\u3044\u9053\u6b21\u7b2c\u3067\u3059\u3002<\/p>\n
json\u30e2\u30b8\u30e5\u30fc\u30eb<\/h5>\n
    \n
  •  \u30e1\u30ea\u30c3\u30c8
    \n\u30c0\u30f3\u30d7\u7d50\u679c\u304c\u3068\u3066\u3082\u8aad\u307f\u3084\u3059\u3044<\/li>\n
  •  \u30c7\u30e1\u30ea\u30c3\u30c8
    \n\u7d20\u306e\u307e\u307e\u3067dump&load\u3067\u304d\u308b\u578b\u304c\u8f9e\u66f8\u3001\u30ea\u30b9\u30c8\u3001\u6587\u5b57\u5217\u3001\u6574\u6570\u3001\u6d6e\u52d5\u5c0f\u6570\u70b9\u6570\u3001True\u3001False\u3001None\u306b\u9650\u3089\u308c\u308b\u3002
    \n\uff08\u305f\u3060\u3057\u3084\u308d\u3046\u3068\u601d\u3048\u3070\u666e\u901a\u306b\u7279\u5b9a\u306e\u578b\u306e\u30ab\u30b9\u30bf\u30e0\u30a8\u30f3\u30b3\u30fc\u30c0\u30fb\u30c7\u30b3\u30fc\u30c0\u3092\u5b9f\u88c5\u3057\u3066\u8ffd\u52a0\u3067\u304d\u308b\u3002\uff09<\/li>\n<\/ul>\n
    pickle\u30e2\u30b8\u30e5\u30fc\u30eb<\/h5>\n
      \n
    •  \u30e1\u30ea\u30c3\u30c8
      \n\u57fa\u672c\u7684\u306b\u3069\u3093\u306a\u578b\u3067\u3082\u30c0\u30f3\u30d7\u3067\u304d\u308b\u3002\uff08\u5404\u30e2\u30b8\u30e5\u30fc\u30eb\u306e\u30c8\u30c3\u30d7\u30ec\u30d9\u30eb\u3067\u5b9a\u7fa9\u3055\u308c\u3066\u306a\u3044\u95a2\u6570\u3084\u30af\u30e9\u30b9\u7b49\u306f\u305d\u306e\u307e\u307e\u3067\u306f\u30c0\u30f3\u30d7\u3067\u304d\u306a\u3044\u3089\u3057\u3044\u3051\u3069\u3002\uff09
      \npickle \u5316\u3084 unpickle \u5316\u3092\u884c\u3046\u30ab\u30b9\u30bf\u30e0\u306e\u30b5\u30d6\u30af\u30e9\u30b9\u3092\u5c0e\u51fa\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u308b\u3002
      \n\u30d0\u30a4\u30ca\u30ea\u5316\u3067\u304d\u308b\u306e\u3067\u5bb9\u91cf\u3092\u98df\u308f\u306a\u3044\u304b\u3082\u3002\uff08\u307e\u3041\u3053\u306e\u70b9\u306fXML\u3068\u6bd4\u3079\u305f\u3089JSON\u3082\u5168\u7136\u30de\u30b7\u3060\u3068\u601d\u3044\u307e\u3059\uff09<\/li>\n
    •  \u30c7\u30e1\u30ea\u30c3\u30c8
      \n\u9045\u3044<\/li>\n<\/ul>\n
      cPickle\u30e2\u30b8\u30e5\u30fc\u30eb<\/h5>\n
        \n
      •  \u30e1\u30ea\u30c3\u30c8
        \n\u57fa\u672c\u7684\u306b\u3069\u3093\u306a\u578b\u3067\u3082\u30c0\u30f3\u30d7\u3067\u304d\u308b\u3002\uff08\u5404\u30e2\u30b8\u30e5\u30fc\u30eb\u306e\u30c8\u30c3\u30d7\u30ec\u30d9\u30eb\u3067\u5b9a\u7fa9\u3055\u308c\u3066\u306a\u3044\u95a2\u6570\u3084\u30af\u30e9\u30b9\u7b49\u306f\u4ee5\u4e0b\u7565\uff09
        \n\u30d0\u30a4\u30ca\u30ea\u5316\u3059\u308b\u306e\u3067\u5bb9\u91cf\u3092\u98df\u308f\u306a\u3044\u3002\uff08\u307e\u3041\u3053\u306e\u70b9\u306fXML\u3068\u6bd4\u3079\u305f\u3089\u4ee5\u4e0b\u7565\uff09
        \n\u901f\u3044<\/li>\n
      •  \u30c7\u30e1\u30ea\u30c3\u30c8
        \npickle \u5316\u3084 unpickle \u5316\u3092\u884c\u3046\u30ab\u30b9\u30bf\u30e0\u306e\u30b5\u30d6\u30af\u30e9\u30b9\u3092\u5c0e\u51fa\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u306a\u3044\u3002<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"
        \u6700\u8fd1\u3088\u304f\u8907\u96d1\u306a\u30aa\u30d6\u30b8\u30a7\u30af\u30c8\u306e\u4fdd\u5b58\u306e\u305f\u3081\u306bJSON\u3092\u4f7f\u3063\u3066\u3044\u307e\u3059\u3002
        \n\u4eba\u9593\u306b\u3082\u8aad\u307f\u3084\u3059\u3044\u306e\u3067\u30c6\u30b9\u30c8\u3084\u30c7\u30d0\u30c3\u30b0\u306b\u4fbf\u5229\u3067\u3059\u3002<\/p>\n
        \u3057\u304b\u3057Web\u30b5\u30fc\u30d3\u30b9\u7b49\u3067\u4f7f\u3046\u3068\u306a\u308b\u3068\u4f7f\u3044\u65b9\u306b\u3082\u3088\u308a\u307e\u3059\u304c\u3001\u7269\u51c4\u3044\u56de\u6570\u30aa\u30d6\u30b8\u30a7\u30af\u30c8\u2192JSON\u3068\u304bJSON\u2192\u30aa\u30d6\u30b8\u30a7\u30af\u30c8\u3068\u304b\u306e\u5909\u63db\u304c\u884c\u308f\u308c\u308b\u4e8b\u306b\u306a\u308a\u307e\u3059\u3002
        \nJSON\u3088\u308a\u3082\u8aad\u307f\u3065\u3089\u304f\u306a\u308a\u307e\u3059\u304c\u3001\u5c02\u7528\u306e\u30d0\u30a4\u30ca\u30ea\u30c7\u30fc\u30bf\u3092\u6271\u3046pickle\u306a\u3089\u3082\u3063\u3068\u901f\u3044\u3093\u3058\u3083\u306a\u3044\u304b\uff1f\u3068\u3044\u3046\u3053\u3068\u3067\u8abf\u3079\u3066\u307f\u307e\u3057\u305f\u3002<\/p>\n
        \u4ee5\u4e0b\u3001\u30c6\u30b9\u30c8\u30b3\u30fc\u30c9\u3002<\/p>\n
        \r\nimport timeit\r\nimport json\r\nimport pickle\r\nimport cPickle\r\n\r\nsource_data = dict(id = 256, title = u'Test title.', tags = ('test', 'other', 'html'), published = True, comments = [])\r\n\r\nrepeat = 3\r\nloop = 100000\r\n\r\ndef to_json(data):\r\n\treturn json.dumps(data)\r\n\r\ndef from_json(data):\r\n\treturn json.loads(data)\r\n\r\ndef to_pickle(data):\r\n\treturn pickle.dumps(data, protocol = 2)\r\n\r\ndef from_pickle(data):\r\n\treturn pickle.loads(data)\r\n\r\ndef to_cPickle(data):\r\n\treturn cPickle.dumps(data, protocol = 2)\r\n\r\ndef from_cPickle(data):\r\n\treturn cPickle.loads(data)\r\n\r\nprint 'to_json'\r\nt = timeit.Timer('to_json(source_data)', 'from __main__ import to_json, source_data')\r\nprint min(t.repeat(repeat, loop))\r\nprint ''\r\n\r\nprint 'to_pickle'\r\nt = timeit.Timer('to_pickle(source_data)', 'from __main__ import to_pickle, source_data')\r\nprint min(t.repeat(repeat, loop))\r\nprint ''\r\n\r\nprint 'to_cPickle'\r\nt = timeit.Timer('to_cPickle(source_data)', 'from __main__ import to_cPickle, source_data')\r\nprint min(t.repeat(repeat, loop))\r\nprint ''\r\n\r\nprint 'from_json'\r\njson_data = to_json(source_data)\r\nt = timeit.Timer('from_json(json_data)', 'from __main__ import from_json, json_data')\r\nprint min(t.repeat(repeat, loop))\r\nprint ''\r\n\r\nprint 'from_pickle'\r\npickle_data = to_pickle(source_data)\r\nt = timeit.Timer('from_pickle(pickle_data)', 'from __main__ import from_pickle, pickle_data')\r\nprint min(t.repeat(repeat, loop))\r\nprint ''\r\n\r\nprint 'from_cPickle'\r\ncPickle_data = to_cPickle(source_data)\r\nt = timeit.Timer('from_cPickle(cPickle_data)', 'from __main__ import from_cPickle, cPickle_data')\r\nprint min(t.repeat(repeat, loop))\r\nprint ''\r\n<\/pre>\n
        \u5b9f\u884c\u7d50\u679c\uff08Python2.7\u4f7f\u7528\uff09<\/p>\n
        \r\nto_json\r\n1.91382908821\r\n\r\nto_pickle\r\n16.7020881176\r\n\r\nto_cPickle\r\n0.530957937241\r\n\r\nfrom_json\r\n2.18486499786\r\n\r\nfrom_pickle\r\n9.6311609745\r\n\r\nfrom_cPickle\r\n0.661497116089\r\n<\/pre>\n
        pickle\u9045\u3044\u3067\u3059\u3002
        \n\u3068\u3044\u3046\u304bjson\u901f\u3044\u3067\u3059\u3002
        \ncPickle\u3068\u6bd4\u3079\u3066\u3053\u306e\u901f\u5ea6\u5dee\u306a\u3089\u3001\u81ea\u5206\u306e\u5178\u578b\u7684\u306a\u4f5c\u6210\u30d1\u30bf\u30fc\u30f3\u3060\u3068\u30c7\u30d0\u30c3\u30b0\u306e\u3057\u3084\u3059\u3055\u3092\u8003\u3048\u3066\u3068\u308a\u3042\u3048\u305ajson\u3067\u3059\u306d\u3002
        \n\u901f\u5ea6\u306b\u6211\u6162\u306a\u3089\u306a\u304f\u306a\u3063\u305f\u3089cPickle\u3002<\/p>\n
        \u3057\u304b\u3057\u305d\u308c\u305e\u308c\u30e1\u30ea\u30c3\u30c8\u30fb\u30c7\u30e1\u30ea\u30c3\u30c8\u3042\u308a\u307e\u3059\u306e\u3067\u4f7f\u3044\u9053\u6b21\u7b2c\u3067\u3059\u3002<\/p>\n
        json\u30e2\u30b8\u30e5\u30fc\u30eb<\/h5>\n
          \n
        •  \u30e1\u30ea\u30c3\u30c8
          \n\u30c0\u30f3\u30d7\u7d50\u679c\u304c\u3068\u3066\u3082\u8aad\u307f\u3084\u3059\u3044<\/li>\n
        •  \u30c7\u30e1\u30ea\u30c3\u30c8
          \n\u7d20\u306e\u307e\u307e\u3067dump&load\u3067\u304d\u308b\u578b\u304c\u8f9e\u66f8\u3001\u30ea\u30b9\u30c8\u3001\u6587\u5b57\u5217\u3001\u6574\u6570\u3001\u6d6e\u52d5\u5c0f\u6570\u70b9\u6570\u3001True\u3001False\u3001None\u306b\u9650\u3089\u308c\u308b\u3002
          \n\uff08\u305f\u3060\u3057\u3084\u308d\u3046\u3068\u601d\u3048\u3070\u666e\u901a\u306b\u7279\u5b9a\u306e\u578b\u306e\u30ab\u30b9\u30bf\u30e0\u30a8\u30f3\u30b3\u30fc\u30c0\u30fb\u30c7\u30b3\u30fc\u30c0\u3092\u5b9f\u88c5\u3057\u3066\u8ffd\u52a0\u3067\u304d\u308b\u3002\uff09<\/li>\n<\/ul>\n
          pickle\u30e2\u30b8\u30e5\u30fc\u30eb<\/h5>\n
            \n
          •  \u30e1\u30ea\u30c3\u30c8
            \n\u57fa\u672c\u7684\u306b\u3069\u3093\u306a\u578b\u3067\u3082\u30c0\u30f3\u30d7\u3067\u304d\u308b\u3002\uff08\u5404\u30e2\u30b8\u30e5\u30fc\u30eb\u306e\u30c8\u30c3\u30d7\u30ec\u30d9\u30eb\u3067\u5b9a\u7fa9\u3055\u308c\u3066\u306a\u3044\u95a2\u6570\u3084\u30af\u30e9\u30b9\u7b49\u306f\u305d\u306e\u307e\u307e\u3067\u306f\u30c0\u30f3\u30d7\u3067\u304d\u306a\u3044\u3089\u3057\u3044\u3051\u3069\u3002\uff09
            \npickle \u5316\u3084 unpickle \u5316\u3092\u884c\u3046\u30ab\u30b9\u30bf\u30e0\u306e\u30b5\u30d6\u30af\u30e9\u30b9\u3092\u5c0e\u51fa\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u308b\u3002
            \n\u30d0\u30a4\u30ca\u30ea\u5316\u3067\u304d\u308b\u306e\u3067\u5bb9\u91cf\u3092\u98df\u308f\u306a\u3044\u304b\u3082\u3002\uff08\u307e\u3041\u3053\u306e\u70b9\u306fXML\u3068\u6bd4\u3079\u305f\u3089JSON\u3082\u5168\u7136\u30de\u30b7\u3060\u3068\u601d\u3044\u307e\u3059\uff09<\/li>\n
          •  \u30c7\u30e1\u30ea\u30c3\u30c8
            \n\u9045\u3044<\/li>\n<\/ul>\n
            cPickle\u30e2\u30b8\u30e5\u30fc\u30eb<\/h5>\n
              \n
            •  \u30e1\u30ea\u30c3\u30c8
              \n\u57fa\u672c\u7684\u306b\u3069\u3093\u306a\u578b\u3067\u3082\u30c0\u30f3\u30d7\u3067\u304d\u308b\u3002\uff08\u5404\u30e2\u30b8\u30e5\u30fc\u30eb\u306e\u30c8\u30c3\u30d7\u30ec\u30d9\u30eb\u3067\u5b9a\u7fa9\u3055\u308c\u3066\u306a\u3044\u95a2\u6570\u3084\u30af\u30e9\u30b9\u7b49\u306f\u4ee5\u4e0b\u7565\uff09
              \n\u30d0\u30a4\u30ca\u30ea\u5316\u3059\u308b\u306e\u3067\u5bb9\u91cf\u3092\u98df\u308f\u306a\u3044\u3002\uff08\u307e\u3041\u3053\u306e\u70b9\u306fXML\u3068\u6bd4\u3079\u305f\u3089\u4ee5\u4e0b\u7565\uff09
              \n\u901f\u3044<\/li>\n
            •  \u30c7\u30e1\u30ea\u30c3\u30c8
              \npickle \u5316\u3084 unpickle \u5316\u3092\u884c\u3046\u30ab\u30b9\u30bf\u30e0\u306e\u30b5\u30d6\u30af\u30e9\u30b9\u3092\u5c0e\u51fa\u3059\u308b\u3053\u3068\u304c\u3067\u304d\u306a\u3044\u3002<\/li>\n<\/ul>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[32],"tags":[355,356,60],"class_list":["post-820","post","type-post","status-publish","format-standard","hentry","category-tech","tag-json","tag-pickle","tag-python"],"_links":{"self":[{"href":"https:\/\/peta.okechan.net\/blog\/wp-json\/wp\/v2\/posts\/820","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/peta.okechan.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/peta.okechan.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/peta.okechan.net\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/peta.okechan.net\/blog\/wp-json\/wp\/v2\/comments?post=820"}],"version-history":[{"count":0,"href":"https:\/\/peta.okechan.net\/blog\/wp-json\/wp\/v2\/posts\/820\/revisions"}],"wp:attachment":[{"href":"https:\/\/peta.okechan.net\/blog\/wp-json\/wp\/v2\/media?parent=820"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/peta.okechan.net\/blog\/wp-json\/wp\/v2\/categories?post=820"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/peta.okechan.net\/blog\/wp-json\/wp\/v2\/tags?post=820"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}