将 csv 写入谷歌云存储

我试图了解如何将多行 csv 文件写入谷歌云存储。我只是没有遵循文档 https://googlecloudplatform.github.io/google-cloud-python/stable/storage-blobs.html?highlight=upload#google.cloud.storage.blob.Blob.upload_from_file

靠近这里：无法读取上传到谷歌云存储桶的csv文件 https://stackoverflow.com/questions/39083960/unable-to-read-csv-file-uploaded-on-google-cloud-storage-bucket

Example:

from google.cloud import storage
from oauth2client.client import GoogleCredentials
import os

os.environ['GOOGLE_APPLICATION_CREDENTIALS'] = "<pathtomycredentials>"

a=[1,2,3]

b=['a','b','c']

storage_client = storage.Client()
bucket = storage_client.get_bucket("<mybucketname>")

blob=bucket.blob("Hummingbirds/trainingdata.csv")

for eachrow in range(3):
    blob.upload_from_string(str(a[eachrow]) + "," + str(b[eachrow]))

这让你在谷歌云存储上有一行

3,c

显然它每次都会打开一个新文件并写入该行。

好的，添加一个新行 delim 怎么样？

for eachrow in range(3):
    blob.upload_from_string(str(a[eachrow]) + "," + str(b[eachrow]) + "\n")

这会添加换行符，但再次从头开始写入。

有人可以说明该方法是什么吗？我可以将所有行组合成一个字符串，或者编写一个临时文件，但这看起来非常丑陋。

也许作为文件打开？

请参考下面的回答，希望对你有帮助。

import pandas as pd
 data = [['Alex','Feb',10],['Bob','jan',12]]
 df = pd.DataFrame(data,columns=['Name','Month','Age'])
 print df

Output

   Name Month  Age
0  Alex   Feb   10
1   Bob   jan   12

添加一行

row = ['Sally','Oct',15]
df.loc[len(df)] = row
print df

output

     Name Month  Age
 0   Alex   Feb   10
 1    Bob   jan   12
 2  Sally   Oct   15

使用 gsutil 写入/复制到 GCP 存储桶

  df.to_csv('text.csv', index = False)
 !gsutil cp 'text.csv' 'gs://BucketName/folderName/'

Python 代码（文档https://googleapis.dev/python/storage/latest/index.html https://googleapis.dev/python/storage/latest/index.html )

from google.cloud import storage

def upload_to_bucket(bucket_name, blob_path, local_path):
    bucket = storage.Client().bucket(bucket_name)
    blob = bucket.blob(blob_path)
    blob.upload_from_filename(local_path)
    return blob.url

# method call
bucket_name = 'bucket-name' # do not give gs:// ,just bucket name
blob_path = 'path/folder name inside bucket'
local_path = 'local_machine_path_where_file_resides' #local file path
upload_to_bucket(bucket_name, blob_path, local_path)