python如何合并批量输出

Question

A文件夹 里面有
1.json
2.json
3.json
.....

格式为

{
   "hello": "hello",
   "data": [
        {
            "id": "123456",
            "create_time": "2016-03-28 11:41:00",
            "phone": "138888****",
            "name": "aaa"
        },
        {
            "id": "456789",
            "create_time": "2016-03-28 11:41:00",
            "phone": "137777****",
            "name": "bbb"
        }
    ]
}

遍历A文件夹
合并data内容
输出1个json和csv

Answer 1

Python2:

import os
import csv
import glob
import json

data = []

for fname in glob.glob(os.path.join('A', '*.json')):
    with open(fname) as f:
        jf = json.loads(f.read())
        data.extend(jf['data'])

with open('output.json', 'w') as f:
    print >>f, json.dumps(data, sort_keys=True, indent=4, separators=(',', ': '))

with open('output.csv', 'w') as f:
    writer = csv.writer(f)
    writer.writerow([key for key, value in data[0].items()])
    for d in data:
        writer.writerow([value for key, value in d.items()])

Python3:

import os
import csv
import glob
import json

data = []

for fname in glob.glob(os.path.join('A', '*.json')):
    with open(fname) as f:
        jf = json.loads(f.read())
        data.extend(jf['data'])

with open('output.json', 'w') as f:
    print(json.dumps(data, sort_keys=True, indent=4, separators=(',', ': ')), file=f)

with open('output.csv', 'w') as f:
    writer = csv.writer(f)
    writer.writerow([key for key, value in data[0].items()])
    for d in data:
        writer.writerow([value for key, value in d.items()])

1. 對於你說的合併，我這邊僅僅是將資料一筆一筆的疊加上去，並沒有作 id 檢查等處理。

2. csv 的輸出要求，可能也要視你想要的格式進行調整。

下面是相關的一些文檔，看完後對你會很有幫助:

• glob

• csv

• os.path

• json

Answer 2

遍历目录用os和os.walk
json处理用json模块
csv处理用csv模块

Answer 3

import glob
glob.glob("*.jon")

也可以。

Answer 4

谢邀

import os.path
import glob
import json

path = os.path.join("A","*.json")
fileList = glob.glob(path)
jsonList = []
for filename in fileList:
    fp = open(filename)
    jsonList.append(
        json.load(fp)
    ) 
    fp.close()
    
for j in jsonList:
    dosomething(j)