我尝试将 csv 文件转换为 200K 对象的 Json 文件,其中对象代表 csv 中的 1 行。
我在 32 位上安装了 Java,并且项目配置 VM 参数:-Xmx1024m
但是我得到:
Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Unknown Source)
at java.lang.AbstractStringBuilder.expandCapacity(Unknown Source)
at java.lang.AbstractStringBuilder.ensureCapacityInternal(Unknown Source)
at java.lang.AbstractStringBuilder.append(Unknown Source)
at java.lang.StringBuffer.append(Unknown Source)
at java.io.StringWriter.write(Unknown Source)
at com.google.gson.stream.JsonWriter.string(JsonWriter.java:478)
at com.google.gson.stream.JsonWriter.value(JsonWriter.java:328)
at com.google.gson.Streams.write(Streams.java:113)
at com.google.gson.Streams.write(Streams.java:136)
at com.google.gson.Streams.write(Streams.java:136)
at com.google.gson.Streams.write(Streams.java:124)
at com.google.gson.Streams.write(Streams.java:136)
at com.google.gson.Gson.toJson(Gson.java:362)
at com.google.gson.Gson.toJson(Gson.java:346)
at com.google.gson.Gson.toJson(Gson.java:260)
at com.google.gson.Gson.toJson(Gson.java:240)
at ConvertFromCsv2JsonTWC.init(ConvertFromCsv2JsonTWC.java:186)
at ConvertFromCsv2JsonTWC.main(ConvertFromCsv2JsonTWC.java:48)
In row:
Gson gson = new Gson();
String output = gson.toJson(container);// <---- crash
对于 50k 行,它工作得很好。
这是我构建的 Json 模板:
{
"crs": {
"type": "none"
},
"type": "FeatureCollection",
"features": [{
"geometry": {
"type": "Point"
},
"properties": {
"ap mac": "00:11:22:33:44:55",
"ssid": "WiFi",
"lat": "35.111111",
"long": "-118.11111",
"address": "370 xxxxxx",
"city": "xxxxxxx",
"state": "CA",
"zip code": "11111",
"country": "US",
"business n": "",
"location c": "Health Club/Gym",
"location q": "",
"indoor fla": "yes"
},
"point": [35.390284,
-118.9929],
"id": 0,
"type": "Feature"
},
{...},
...
200000...
所以我有 200K 对象properties
list
解决方法是创建每个 20k 的单独文件,但这不是好方法。
我该如何解决这个问题?
谢谢,