如何分组并根据总和过滤数据框？

2024-03-16

所以我有一个数据框 milk_countries_exports，它由以下列组成：

“期间”，特定行的年份和月份（数据集是一年中的逐月）
正在做出口的“记者”国家
从“报告者”进口的“伙伴”国家
“商品”由 2 项组成，“既不浓缩也不加糖的牛奶和奶油”，以及“浓缩或加糖的牛奶和奶油”
“商品代码”，是分配给商品类型的编号，因此分别为“0401”和“0402”
“贸易价值（美元）”，该行的给定月份、国家/地区和商品类型发生的贸易额

我被要求：

过滤数据集，使其仅包含总计满足以下条件的行：特定国家所有奶制品的出口额为在任何给定的每月期间至少有 200 万美元。（提示：分组合作伙伴和期间，并针对测试的函数进行过滤最低贸易价值超过要求的价值。）

对我来说，这似乎意味着对于每个给定的月份和合作伙伴，如果该月（例如 201401）和合作伙伴（例如德国）的 0401 和 0402 之和大于 200 万美元，则保留这两行，否则将其过滤掉。因此，如果对于一对月份伴侣，0401 和 0402 的值分别为 900,000 和 2,000,000，则总和为 2,900,000，因此两行都会保留，即使其中一行小于 200 万阈值，因为它超出了0401 和 0402 的总和，而不是它们各自的值。

作为数据中的参考点，我使用了“德国”的前几行，因为作为合作伙伴，它包含 0401 和 0402 的示例（许多合作伙伴只有一个或另一个），并且至关重要的是，第一个月包含一个案例0401 低于 200 万阈值（982240），0402 为 3187636，超过阈值。因此，如果过滤后其中一行或两行丢失，我就知道我做错了什么。

我尝试以这种方式应用它：

我定义了一个函数来测试数据集是否满足大于或等于 200 万的标准：

def groupsWithExportsOver2million (g): 

    return g['Trade Value (US$)'].min() >= 2000000

Then:

milk_countries_exports[milk_countries_exports['Partner'] == 'Germany'].groupby(['Period', 'Partner']).filter(groupsWithExportsOver2million)

这会产生一个完全空白的数据框，并且：

milk_countries_exports[milk_countries_exports['Period'] == '201401'].groupby(['Period', 'Partner']).filter(groupsWithExportsOver2million)

做同样的事。然而：

milk_countries_exports.groupby(['Period', 'Partner']).filter(groupsWithExportsOver2million).sort_values('Trade Value (US$)')

（即显示整个数据集，而不仅仅是仅显示一个国家或时期组）会生成一个 56 行的数据框，其中仅包含超过 200 万行的“贸易价值（美元）”行，我认为但我不确定，它的过滤方式是，如果任何伙伴国家或任何时期值在数据框中的任何位置的贸易价值小于 200 万，则整个国家或时期的值将从结果数据框中消除。或者，换句话说，留下一个仅包含每个实例中贸易价值高于 200 万的国家和月份的表格。

我可以组合每个国家/时期对的 0401 和 0402 的值，并根据过滤器测试该总和，但这当然会返回一个数据帧，其中 0401 和 0402 组合为一个值，而实际上我想要做的的目的是能够对它们求和，测试过滤器，然后将它们分开，这样 0401 和 0402 仍然单独存在。

我该如何做我想做的事？

Data:

# copy data and create dataframe with 
df = pd.read_clipboard(sep=',')

Period,Reporter,Partner,Commodity,Commodity Code,Trade Value (US$)
2014-09-01,United Kingdom,World,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,33279381
2014-09-01,United Kingdom,Australia,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,4558
2014-09-01,United Kingdom,Austria,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,290
2014-09-01,United Kingdom,Barbados,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,3016
2014-09-01,United Kingdom,Belgium,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,578297
2014-09-01,United Kingdom,Br. Virgin Isds,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,33746
2014-09-01,United Kingdom,Canada,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,34657
2014-09-01,United Kingdom,China,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,1547888
2014-09-01,United Kingdom,Cyprus,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,20199
2014-09-01,United Kingdom,Denmark,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,89685
2014-09-01,United Kingdom,Falkland Isds (Malvinas),Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,35560
2014-09-01,United Kingdom,Finland,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,141693
2014-09-01,United Kingdom,France,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,599127
2014-09-01,United Kingdom,Germany,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,587925
2014-09-01,United Kingdom,Gibraltar,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,29503
2014-09-01,United Kingdom,Greece,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,55
2014-09-01,United Kingdom,Guyana,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,74259
2014-09-01,United Kingdom,"China, Hong Kong SAR",Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,73082
2014-09-01,United Kingdom,Hungary,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,4141
2014-09-01,United Kingdom,Ireland,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,28619275
2014-09-01,United Kingdom,Italy,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,11989
2014-09-01,United Kingdom,Japan,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,3337
2014-09-01,United Kingdom,Lithuania,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,275
2014-09-01,United Kingdom,Malta,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,3756
2014-09-01,United Kingdom,"Other Asia, nes",Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,5040
2014-09-01,United Kingdom,Netherlands,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,406087
2014-09-01,United Kingdom,Portugal,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,3939
2014-09-01,United Kingdom,Qatar,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,10796
2014-09-01,United Kingdom,Saint Helena,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,3323
2014-09-01,United Kingdom,Singapore,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,10254
2014-09-01,United Kingdom,Viet Nam,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,10529
2014-09-01,United Kingdom,Slovenia,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,11
2014-09-01,United Kingdom,South Africa,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,8067
2014-09-01,United Kingdom,Spain,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,210956
2014-09-01,United Kingdom,Trinidad and Tobago,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,9680
2014-09-01,United Kingdom,United Arab Emirates,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,37348
2014-09-01,United Kingdom,United States of America,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,67035
2014-05-01,United Kingdom,World,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,21665661
2014-05-01,United Kingdom,Denmark,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,2311364
2014-05-01,United Kingdom,France,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,1638838
2014-05-01,United Kingdom,Germany,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,2199671
2014-05-01,United Kingdom,Italy,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,9950
2014-09-01,United Kingdom,World,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,27320918
2014-09-01,United Kingdom,Algeria,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,1659167
2014-09-01,United Kingdom,Angola,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,923506
2014-09-01,United Kingdom,Austria,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,443
2014-09-01,United Kingdom,Bangladesh,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,895167
2014-09-01,United Kingdom,Barbados,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,2027
2014-09-01,United Kingdom,Belgium,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,83721
2014-09-01,United Kingdom,Cameroon,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,83356
2014-09-01,United Kingdom,Sri Lanka,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,15332
2014-09-01,United Kingdom,China,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,1460603
2014-09-01,United Kingdom,Congo,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,673852
2014-09-01,United Kingdom,Cuba,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,849676
2014-09-01,United Kingdom,Cyprus,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,13521
2014-09-01,United Kingdom,Benin,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,112444
2014-09-01,United Kingdom,Denmark,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,63293
2014-09-01,United Kingdom,Dominican Rep.,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,535019
2014-09-01,United Kingdom,Finland,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,209
2014-09-01,United Kingdom,France,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,262833
2014-09-01,United Kingdom,Germany,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,2921594
2014-09-01,United Kingdom,Greece,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,52
2014-09-01,United Kingdom,Guinea,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,441798
2014-09-01,United Kingdom,Guyana,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,65483
2014-09-01,United Kingdom,"China, Hong Kong SAR",Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,1210921
2014-09-01,United Kingdom,Hungary,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,28794
2014-09-01,United Kingdom,Iraq,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,111141
2014-09-01,United Kingdom,Ireland,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,5498955
2014-09-01,United Kingdom,Italy,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,4204
2014-09-01,United Kingdom,Côte d'Ivoire,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,2322223
2014-09-01,United Kingdom,Jamaica,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,131078
2014-09-01,United Kingdom,Kuwait,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,623076
2014-09-01,United Kingdom,Lebanon,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,388137
2014-09-01,United Kingdom,Latvia,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,37
2014-09-01,United Kingdom,Malaysia,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,284043
2014-09-01,United Kingdom,Mali,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,220000
2014-09-01,United Kingdom,Malta,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,12190
2014-09-01,United Kingdom,Mauritania,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,73724
2014-09-01,United Kingdom,Mauritius,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,108406
2014-09-01,United Kingdom,Netherlands,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,979298
2014-09-01,United Kingdom,Nigeria,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,308385
2014-09-01,United Kingdom,Norway,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,5736
2014-09-01,United Kingdom,Pakistan,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,8151
2014-09-01,United Kingdom,Panama,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,142387
2014-05-01,United Kingdom,Lithuania,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,9354
2014-05-01,United Kingdom,Netherlands,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,664032
2014-05-01,United Kingdom,Portugal,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,912
2014-05-01,United Kingdom,Romania,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,225281
2014-05-01,United Kingdom,Slovakia,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,45434
2014-05-01,United Kingdom,Sweden,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,64547
2014-05-01,United Kingdom,United Arab Emirates,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,6742
2014-05-01,United Kingdom,Belgium,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,2707248
2014-05-01,United Kingdom,Ireland,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,11065926
2014-05-01,United Kingdom,Poland,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,716363
2014-10-01,United Kingdom,World,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,26615557
2014-10-01,United Kingdom,Austria,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,745
2014-10-01,United Kingdom,Belgium,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,609637
2014-10-01,United Kingdom,Bermuda,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,1439
2014-10-01,United Kingdom,Canada,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,27639
2014-10-01,United Kingdom,Sri Lanka,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,2230
2014-10-01,United Kingdom,China,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,1493672
2014-10-01,United Kingdom,Cyprus,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,5509
2014-10-01,United Kingdom,Denmark,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,72569
2014-10-01,United Kingdom,Falkland Isds (Malvinas),Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,15189
2014-10-01,United Kingdom,Finland,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,184498
2014-10-01,United Kingdom,France,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,658064
2014-10-01,United Kingdom,Germany,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,936431
2014-10-01,United Kingdom,Gibraltar,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,13367
2014-10-01,United Kingdom,Guatemala,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,200251
2014-10-01,United Kingdom,"China, Hong Kong SAR",Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,265362
2014-10-01,United Kingdom,Hungary,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,11
2014-10-01,United Kingdom,Ireland,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,21360068
2014-10-01,United Kingdom,Italy,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,12806
2014-10-01,United Kingdom,Japan,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,2127
2014-10-01,United Kingdom,Rep. of Korea,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,18549
2014-10-01,United Kingdom,Luxembourg,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,58
2014-10-01,United Kingdom,Malta,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,14189
2014-10-01,United Kingdom,Netherlands,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,337973
2014-10-01,United Kingdom,Portugal,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,3142
2014-10-01,United Kingdom,Singapore,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,8653
2014-10-01,United Kingdom,Viet Nam,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,10406
2014-10-01,United Kingdom,South Africa,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,7512
2014-10-01,United Kingdom,Spain,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,195426
2014-10-01,United Kingdom,United Arab Emirates,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,37325
2014-10-01,United Kingdom,Ukraine,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,2587
2014-10-01,United Kingdom,United States of America,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,118121
2014-07-01,United Kingdom,World,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,39508127
2014-07-01,United Kingdom,Afghanistan,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,4017
2014-07-01,United Kingdom,Austria,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,365
2014-07-01,United Kingdom,Bahrain,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,3348
2014-07-01,United Kingdom,Belgium,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,842327
2014-07-01,United Kingdom,Bermuda,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,2062
2014-07-01,United Kingdom,Br. Virgin Isds,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,39168
2014-07-01,United Kingdom,Canada,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,33987
2014-07-01,United Kingdom,Sri Lanka,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,3170
2014-07-01,United Kingdom,China,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,1178497
2014-07-01,United Kingdom,Cyprus,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,21465
2014-07-01,United Kingdom,Denmark,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,111562
2014-07-01,United Kingdom,Falkland Isds (Malvinas),Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,23319
2014-07-01,United Kingdom,Finland,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,135463
2014-07-01,United Kingdom,France,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,3606510
2014-07-01,United Kingdom,Germany,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,898346
2014-07-01,United Kingdom,Gibraltar,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,8565
2014-07-01,United Kingdom,Greece,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,1743
2014-07-01,United Kingdom,"China, Hong Kong SAR",Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,665185
2014-07-01,United Kingdom,Hungary,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,8635
2014-07-01,United Kingdom,Ireland,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,29943028
2014-07-01,United Kingdom,Italy,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,14349
2014-07-01,United Kingdom,Japan,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,7631
2014-07-01,United Kingdom,Rep. of Korea,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,2489
2014-07-01,United Kingdom,Malta,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,23238
2014-07-01,United Kingdom,Netherlands,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,1424401
2014-07-01,United Kingdom,Portugal,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,9260
2014-07-01,United Kingdom,Singapore,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,7865
2014-07-01,United Kingdom,Viet Nam,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,11085
2014-07-01,United Kingdom,South Africa,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,9104
2014-07-01,United Kingdom,Spain,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,311615
2014-07-01,United Kingdom,Sweden,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,792
2014-07-01,United Kingdom,Switzerland,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,1444
2014-07-01,United Kingdom,United Arab Emirates,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,25733
2014-07-01,United Kingdom,United States of America,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,128358
2014-06-01,United Kingdom,World,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,16022428
2014-06-01,United Kingdom,Belgium,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,1346169
2014-06-01,United Kingdom,Denmark,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,1972893
2014-06-01,United Kingdom,France,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,1449614
2014-06-01,United Kingdom,Germany,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,1856919
2014-06-01,United Kingdom,Ireland,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,7597407
2014-06-01,United Kingdom,Italy,Milk and cream; not concentrated nor containing added sugar or other sweetening matter,0401,8011
2014-09-01,United Kingdom,Poland,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,528311
2014-09-01,United Kingdom,Portugal,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,4418
2014-09-01,United Kingdom,Saint Lucia,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,11489
2014-09-01,United Kingdom,Saudi Arabia,Milk and cream; concentrated or containing added sugar or other sweetening matter,0402,715791

尝试解决方案时出现错误消息：

---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
<ipython-input-131-1bce8906203d> in <module>
----> 1 df_filtered = milk_countries_exports.groupby(['Partner', pd.Grouper(key='Period', freq='1M')]).filter(lambda x: x['Trade Value (US$)'].sum() > 2000000)

~\anaconda3\lib\site-packages\pandas\core\frame.py in groupby(self, by, axis, level, as_index, sort, group_keys, squeeze, observed)
   5808             group_keys=group_keys,
   5809             squeeze=squeeze,
-> 5810             observed=observed,
   5811         )
   5812 

~\anaconda3\lib\site-packages\pandas\core\groupby\groupby.py in __init__(self, obj, keys, axis, level, grouper, exclusions, selection, as_index, sort, group_keys, squeeze, observed, mutated)
    407                 sort=sort,
    408                 observed=observed,
--> 409                 mutated=self.mutated,
    410             )
    411 

~\anaconda3\lib\site-packages\pandas\core\groupby\grouper.py in get_grouper(obj, key, axis, level, sort, observed, mutated, validate)
    623                 in_axis=in_axis,
    624             )
--> 625             if not isinstance(gpr, Grouping)
    626             else gpr
    627         )

~\anaconda3\lib\site-packages\pandas\core\groupby\grouper.py in __init__(self, index, grouper, obj, name, level, sort, observed, in_axis)
    294             # check again as we have by this point converted these
    295             # to an actual value (rather than a pd.Grouper)
--> 296             _, grouper, _ = self.grouper._get_grouper(self.obj, validate=False)
    297             if self.name is None:
    298                 self.name = grouper.result_index.name

~\anaconda3\lib\site-packages\pandas\core\resample.py in _get_grouper(self, obj, validate)
   1409     def _get_grouper(self, obj, validate: bool = True):
   1410         # create the resampler and return our binner
-> 1411         r = self._get_resampler(obj)
   1412         r._set_binner()
   1413         return r.binner, r.grouper, r.obj

~\anaconda3\lib\site-packages\pandas\core\resample.py in _get_resampler(self, obj, kind)
   1402 
   1403         raise TypeError(
-> 1404             "Only valid with DatetimeIndex, "
   1405             "TimedeltaIndex or PeriodIndex, "
   1406             f"but got an instance of '{type(ax).__name__}'"

TypeError: Only valid with DatetimeIndex, TimedeltaIndex or PeriodIndex, but got an instance of 'Int64Index'

g['Trade Value (US$)'].min() >= 2000000过滤掉所有内容，因为这意味着最小值必须大于 2000000。
Use pandas.Grouper https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.Grouper.html分组依据Period以指定的频率。
pandas.core.groupby.DataFrameGroupBy.filter https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.core.groupby.DataFrameGroupBy.filter.html to filter based on the sum of 'Trade Value (US$)'.
- x['Trade Value (US$)'].sum() > 2000000是过滤函数。可以将其放入外部def功能，但不是必须的。
Commodity Code can also be added to the groupby:
- groupby(['Partner', 'Commodity Code', pd.Grouper(key='Period', freq='1M')])

import pandas as pd

# load the data
df = pd.read_csv('https://raw.githubusercontent.com/trenton3983/stack_overflow/master/data/so_data/2020-09-01%2063694704/comtrade.csv', dtype={'Commodity Code': str})

# select desired columns
df = df.loc[:, ['Period', 'Reporter', 'Partner', 'Commodity', 'Commodity Code', 'Trade Value (US$)']]

# convert Period to datetime format
df.Period = pd.to_datetime(df.Period, format='%Y%m')

# display(df.head(3))
      Period        Reporter    Partner                                                                               Commodity Commodity Code  Trade Value (US$)
0 2014-09-01  United Kingdom      World  Milk and cream; not concentrated nor containing added sugar or other sweetening matter           0401           33279381
1 2014-09-01  United Kingdom  Australia  Milk and cream; not concentrated nor containing added sugar or other sweetening matter           0401               4558
2 2014-09-01  United Kingdom    Austria  Milk and cream; not concentrated nor containing added sugar or other sweetening matter           0401                290

# groupby Partner and month, and filter by sum of Trade value > 2000000
df_filtered = df.groupby(['Partner', pd.Grouper(key='Period', freq='1M')]).filter(lambda x: x['Trade Value (US$)'].sum() > 2000000)

# verify the period Trade Value sums per partner per month are > 2000000
df_filtered.groupby(['Partner', pd.Grouper(key='Period', freq='1M')]).agg({'Trade Value (US$)': sum})

[out]:
                                 Trade Value (US$)
Partner              Period                       
Algeria              2014-01-31            4792662
                     2014-02-28            7220679
                     2014-03-31            9835523
                     2014-04-30           14875816
                     2014-05-31           19656679
                     2014-06-30           22411564
                     2014-07-31            3214364
                     2014-10-31            4074424
                     2014-11-30            2107597
                     2014-12-31            3464600
Angola               2014-03-31            2324977
                     2014-12-31            2030001
Belgium              2014-01-31           14531571
                     2014-02-28            6955784
                     2014-03-31            9576248
                     2014-04-30            8569745
                     2014-05-31            7635442
                     2014-06-30            5435766
                     2014-07-31            5128432
                     2014-08-31            5169545
                     2014-09-30            5707207
                     2014-10-31            4982965
                     2014-11-30            8547975
                     2014-12-31            5441072
China                2014-03-31            2460056
                     2014-07-31            2778780
                     2014-09-30            3008491
                     2014-10-31            4777912
                     2014-11-30            3774279
                     2014-12-31            3045122
China, Hong Kong SAR 2014-01-31            2170443
                     2014-07-31            2048469
                     2014-11-30            2049788
Côte d'Ivoire        2014-03-31            2842636
                     2014-06-30            2499308
                     2014-08-31            2173727
                     2014-09-30            2322223
Denmark              2014-01-31            2399943
                     2014-02-28            2136906
                     2014-03-31            2523950
                     2014-04-30            2523958
                     2014-05-31            2490132
                     2014-06-30            2191829
                     2014-07-31            3180516
                     2014-08-31            2497068
                     2014-09-30            3052401
                     2014-10-31            3019545
                     2014-11-30            2929672
                     2014-12-31            4497179
France               2014-01-31           12651302
                     2014-02-28           10284508
                     2014-03-31           14342231
                     2014-04-30           12846655
                     2014-05-31           12826328
                     2014-06-30           11756821
                     2014-07-31           13075198
                     2014-08-31            9966348
                     2014-09-30           10636585
                     2014-10-31           11120326
                     2014-11-30           10612800
                     2014-12-31            9512056
Germany              2014-01-31            9744449
                     2014-02-28            7688820
                     2014-03-31            8956210
                     2014-04-30           10604432
                     2014-05-31           10207829
                     2014-06-30           10104134
                     2014-07-31            7074641
                     2014-08-31            7768101
                     2014-09-30           12061074
                     2014-10-31           13060791
                     2014-11-30            8306606
                     2014-12-31            7132246
Ghana                2014-01-31            2389385
Guinea               2014-04-30            2098146
                     2014-05-31            2179330
Ireland              2014-01-31           57621249
                     2014-02-28           53529377
                     2014-03-31           52525722
                     2014-04-30           55134986
                     2014-05-31           57244611
                     2014-06-30           56814970
                     2014-07-31           52322023
                     2014-08-31           45421969
                     2014-09-30           51185200
                     2014-10-31           38818201
                     2014-11-30           37431831
                     2014-12-31           37494188
Lebanon              2014-07-31            2359805
Netherlands          2014-01-31           15376408
                     2014-02-28            9160546
                     2014-03-31           11064742
                     2014-04-30           15584558
                     2014-05-31           13182208
                     2014-06-30           14262841
                     2014-07-31           10843821
                     2014-08-31            7521907
                     2014-09-30            8164473
                     2014-10-31           13886896
                     2014-11-30           14965454
                     2014-12-31            6844463
Nigeria              2014-08-31            4676807
Poland               2014-09-30            2680608
                     2014-11-30            2694120
Spain                2014-01-31            2075305
                     2014-09-30            3185937
                     2014-10-31            2421800
                     2014-11-30            2318918
World                2014-01-31          139512730
                     2014-02-28          111789785
                     2014-03-31          131100878
                     2014-04-30          139406387
                     2014-05-31          144276262
                     2014-06-30          144420208
                     2014-07-31          117675469
                     2014-08-31          102032532
                     2014-09-30          117302843
                     2014-10-31          113368963
                     2014-11-30          106377174
                     2014-12-31           95273667
Yemen                2014-08-31            3311725

资源

商品贸易统计数据库数据分析 https://share.cocalc.com/share/2c4fc9474ae992ef364a822b2f2bfe737ca7fe2f/Week_4_exercises.ipynb?viewer=share- 这是我找到如何获取数据的地方
UN Comtrade Database https://comtrade.un.org/data/ - Data available here
- 产品类型：商品
- 频率：每月
- 期间：2014年全年
- 记者：英国
- 合作伙伴：全部
- 流量：进口和出口
- HS（据报道）商品代码：0401（牛奶和奶油，既不浓缩也不加糖）和0402（牛奶和奶油，浓缩或加糖）
- 单击“预览”会显示一条消息，指出数据超过 500 行。使用“下载 CSV”按钮下载数据，并适当重命名下载文件。

本文内容由网友自发贡献，版权归原作者所有，本站不承担相应法律责任。如您发现有涉嫌抄袭侵权的内容，请联系:hwhale#tublm.com(使用前将#替换为@)

如何分组并根据总和过滤数据框？的相关文章

numpy python 中的“AttributeError：'matrix'对象没有属性'strftime'”错误

我有一个维度为 72000 1 的矩阵该矩阵涉及时间戳我想使用 strftime 如下所示 strftime d m y 为了得到像这样的输出 11 03 02 我有这样一个矩阵 M np matrix timestamps 我使用了
ctypes 错误：libdc1394 错误：无法初始化 libdc1394

我正在尝试将程序编译为共享库我可以使用 ctypes 在 Python 代码中使用该库使用以下命令该库可以正常编译 g shared Wl soname mylib O3 o mylib so fPIC files pkg config
cv2.drawContours() - 取消填充字符内的圆圈（Python，OpenCV）

根据 Silencer的建议我使用了他发布的代码here https stackoverflow com questions 48244328 copy shape to blank canvas opencv python 482465
字符串中的注释和注释中的字符串

我正在尝试使用 Python 和 Regex 计算 C 代码中包含的注释中的字符数但没有成功我可以先删除字符串以删除字符串中的注释但这也会删除注释中的字符串结果会很糟糕是否有机会通过使用正则表达式来询问不匹配注释中的字符串反之亦
“一旦获取切片就无法更新查询”。最佳实践？

由于我的项目的性质我发现自己不断地从查询集中取出切片如下所示 Thread objects filter board requested board id order by updatedate 10 但这给我带来了实际对我选择的元素进
Python tkinter.filedialog Askfolder 干扰 clr

我主要在 Spyder 中工作构建需要弹出文件夹或文件浏览窗口的脚本下面的代码在spyder中完美运行在 Pycharm 中 askopenfilename工作良好同时askdirectory什么都不做卡住了但是如果在调试模式
编辑 Jupyter Notebook 时 VS Code 中缺少“在选择中查找”

使用 Jupyter Notebook 时 VSCode 中缺少在选择中查找按钮它会减慢开发速度所以我想请问有人知道如何激活它吗第一张图显示了在 python 文件中的搜索替换第二张图显示了笔记本电脑中缺少的按钮 Python
如何使用正则表达式在 pandas 数据框中选择一行以及包含特定子字符串的行后面的固定行数

Problem 我有一个 pandas 数据框我试图从中提取特定行我感兴趣的行是包含日期的行以及紧随日期行之后的行重要的是我想将信息从日期后面的行移动到包含日期的行中的新列通过这样做我将在同一行上获得一个人的信息需要明确
如何使用 javascript/jquery/AJAX 调用 Django REST API？

我想使用 Javascript jQuery AJAX 在前端调用 Django Rest API 请求方法是 POST 但当我看到 API 调用它的调用 OPTIONS 方法时所以我开始了解access control allow o
Pandas：如何将数据框插入 Clickhouse

我正在尝试将 Pandas 数据框插入 Clickhouse 这是我的代码 import pandas import sqlalchemy as sa uri clickhouse default localhost default ch
Alembic：如何迁移模型中的自定义类型？

My User模型是 class User UserMixin db Model tablename users noinspection PyShadowingBuiltins uuid Column uuid GUID default
揭秘sharedctypes性能

在 python 中可以在多个进程之间共享 ctypes 对象然而我注意到分配这些对象似乎非常昂贵考虑以下代码 from multiprocessing import sharedctypes as sct import ctypes
如何使用 Bokeh 动态隐藏字形和图例项

我正在尝试在散景中实现复选框其中每个复选框应显示隐藏与其关联的行我知道可以通过图例来实现这一点但我希望这种效果同时在两个图中发生此外图例也应该更新在下面的示例中出现了复选框但不执行任何操作我显然不明白如何更新用作源的数据
如何在 Azure 数据工厂 - Databricks 中使用 continuation_token 获取 ADF Pipeline 运行详细信息的下一页？

我在用 adf client pipeline runs query by factory resourceGroupName 工厂名称过滤器参数的方法azure mgmt datafactory DataFactoryManageme
Pandas 堆积条形图中元素的排序

我正在尝试绘制有关某个地区 5 个地区的家庭在特定行业赚取的收入比例的信息我使用 groupby 按地区对数据框中的信息进行排序 df df orig groupby District Portion of income value co
在 Spyder 的变量资源管理器中查看局部变量

我是 python 新手正在使用 Spyder 的 IDE 我欣赏它的一项功能是它的变量资源管理器然而根据一些研究我发现它只显示全局变量我找到的解决方法是使用检查模块 import inspect local vars def m
合并数据框而不重复行

我想合并两个数据框但如果有多个匹配项则不想重复行相反我想总结一下那天的观察结果来自合并提取两个数据框中与指定列匹配的行并将其连接在一起如果有多个匹配项则所有可能的匹配项各贡献一行这是一些示例代码 days lt as d
使用 NLP 进行地址分割

我目前正在开发一个项目该项目应识别地址的每个部分例如来自 str Jack London 121 Corvallis ARAD ap 1603 973130 输出应如下所示 street name Jack London no 121
以编程方式使用 Sphinx 特定指令解析 .rst 文件

我希望能够在 Python 中解析基于 sphinx 的 rst 以便进一步处理和检查就像是 import sphinx p sphinx parse path to file rst do something with p 似乎在 do
python 中的 after() 与 update()

我是 python 新手开始使用 tkinter 作为画布到目前为止我使用 update 来更新我的画布但还有一个 after 方法谁能给我解释一下这个函数请举个例子两者之间有什么区别 root after integer c

随机推荐

无法在装饰器中捕获 pytest 的结果

我的 pytest 测试装饰器在调用函数后立即退出装饰器如果我使用 python 而不是 pytest 运行该文件效果会很好这是代码 def dec func def wrapper args kwargs print do some
JFreeChart 不会在线程上的每次迭代时显示图形？

我使用线程在一个类中获取计数器值并写入JFreeChart在另一个线程中执行时它交替工作但只显示最后的图形它还将 y 轴标签值显示为 Float 但实际检索值是 int 我该如何解决这些问题 XYDataset Dataset Ti
在 Rails 中，哪里是放置需要“随处”可用的方法的正确位置

我已经将许多小实用方法例如用于重新格式化或解析字符串等简单对象放入了 ApplicationHelper 中但是模型中的类方法显然无法访问 ApplicationHelper 方法有一个解决方法那就是在我的项目中进行洒水 inc
在 Java 中动态加载模块（类）的最佳方法

我目前正在编写一个需要在不同类型的设备上运行的应用程序我的方法是制作一个模块化应用程序可以根据需要操作的设备动态加载不同的类为了使应用程序易于扩展我的目标是为附加模块 jar 或 class 文件分配特定路径而核心程序保持原
如何获取和设置当前网页滚动位置？

如何获取和设置当前网页滚动位置我有一个很长的表单需要根据用户操作输入进行刷新发生这种情况时页面会重置到最顶部这对用户来说很烦人因为他们必须向下滚动回到原来的位置如果我可以在页面重新加载之前捕获当前滚动位置在隐藏输入中那么
如何列出包中的所有类和方法/函数 - 具有完整的文件夹/文件路径？

为了更好地理解包的结构假设我们有一些包模块比如说 somemodule 结构如下 somemodule file1 py fo x a function file2 py bar x a function dir1 file3 py
在 Rails 应用程序中实现投票的最佳方式？

目前在 Rails 站点上实现投票的最佳插件是什么我知道的两个是 vote fu http github com peteonrails vote fu 行为可投票 http github com ryanto acts as votab
JPA CriteriaBuilder 案例查询

任何人都可以提供如何使用编写案例查询的示例CriteriaBuilder 以下是使用的示例案例表达式CriteriaBuilder 这适用于 JPA 2 Hashtable caseTable new Hashtable 3 caseTab
Jquery视差滚动效果-多方向

我需要为客户构建一个多方向 JQuery 视差页面他们基本上希望它以与此类似的方式工作 https victoriabeckham landrover com INT https victoriabeckham landrover com
从 shell 脚本获取 pytest 退出代码

我正在从 shell 脚本运行 pytest 测试脚本中的相关行类似于 pytest pytest tests param my param 根据 pytest 文档运行 pytest 可能会导致六种不同的退出代码 0 5 我的问题是如
PHP 数组插入无法按预期工作

我正在尝试插入一些项目假设nitems 它们都彼此不同到一个数组不知何故最终的数组包括n items 它们都是相同的项目最后插入的项目这是我的代码 searchResults data foreach allowSearch a
当应用程序在后台时获取本地通知

当应用程序在后台时不会调用 didReceive Local notification 所以我尝试从 didFinishLaunchingWithOptions 获取通知 BOOL application UIApplication ap
使用 ffmpeg 创建视频

我有 100 张图像 PNG 我想使用这些图像创建一个视频我为此使用 ffmpeg 库使用命令行我可以轻松创建视频但是我如何通过编码来做到这一点呢任何帮助将不胜感激 pragma GCC diagnostic ignored Wde
为什么我不应该对 TD（表格单元格）上的数字使用已弃用的align='right'？

我指的是用于显示表格数据的表格的用法例如电子表格重点关注numbers 我感觉并在用户体验中查看 https ux stackexchange com a 24073应该右对齐格式正确具有相同的小数位数以方便求和对于数字来说
带组的 Google 柱形图

我的数据格式 Group Count Month Year A 10 February 2015 B 8 February 2015 C 15 February 2016 我将使用过滤器来显示按组列分隔的每个月的数据 X axis会有团体
将固定大小的 Map 序列化为 CBOR

我有以下 JSON 2 c true 3 p 10 我想转换为 CBOR 格式根据 cbor me 我有以下输出 82A102A16163F5A103A161700A 但是当使用 Jackson Binary CBOR Serializ
GCC链接器找不到标准库？

我一直在使用 XCode 开发一个学校项目最终产品必须以带有 makefile 的源代码形式提交因此我编写了一个 makefile 并开始以这种方式进行编译以确保我有一个工作副本这是我的生成文件 all main o StackLi
如何扩展具有动态形成选择器的类/混合

如何扩展使用组合器动态形成的 Less 类 less 产生预期输出 hello world color red foo extend hello world font size 20px 预期的 CSS 输出 hello world fo
pandas 数据框任意两列之间的百分比差异

我想定义一个函数来计算任意两个 pandas 列之间的百分比差异假设我的数据框是由以下定义的 R1 R2 R3 R4 R5 R6 A B 1 2 3 4 我希望我的计算定义为 df R7 df R3 R4 apply method cal
如何分组并根据总和过滤数据框？

所以我有一个数据框 milk countries exports 它由以下列组成期间特定行的年份和月份数据集是一年中的逐月正在做出口的记者国家从报告者进口的伙伴国家商品由 2 项组成既不浓缩也不加糖的牛奶和奶油

如何分组并根据总和过滤数据框？

Data:

资源

如何分组并根据总和过滤数据框？ 的相关文章

随机推荐

热门标签

如何分组并根据总和过滤数据框？的相关文章