我明白了有状态 LSTM 预测示例 https://github.com/fchollet/keras/blob/master/examples/stateful_lstm.py在 Keras 中的单个序列上。该示例有一个包含 50k 个观察值的序列。
我的问题:
- 如果您想训练 50k 个观测值的多个序列怎么办?比如说以不同的值开始/结束并且行为略有不同的一个?
- 如何修改示例以增加预测时间步长?
- LSTM 对这类事情有用吗?
完全可复制的示例,具有 3 个均值回归时间序列并预测 20 个步骤。
# generate random data
import statsmodels.api as sm
import numpy as np
import pandas as pd
cfg_t_total = 25000
cfg_t_step = 20
cfg_batch_size = 100
np.random.seed(12345)
arparams = np.array([.75, -.25])
maparams = np.array([.65, .35])
ar = np.r_[1, -arparams] # add zero-lag and negate
ma = np.r_[1, maparams] # add zero-lag
y0 = sm.tsa.arma_generate_sample(ar, ma, cfg_t_total)
y1 = sm.tsa.arma_generate_sample(ar, ma, cfg_t_total)
y2 = sm.tsa.arma_generate_sample(ar, ma, cfg_t_total)
df=pd.DataFrame({'a':y0,'b':y1,'c':y2})
df.head(100).plot()
df.head(5)
# create training data format
X = df.unstack()
y = X.groupby(level=0).shift(-cfg_t_step)
idx_keep = ~(y.isnull())
X = X.ix[idx_keep]
y = y.ix[idx_keep]
from keras.models import Sequential
from keras.layers import Dense, LSTM
# LSTM taken from https://github.com/fchollet/keras/blob/master/examples/stateful_lstm.py
# how to do this...?!
print('Creating Model')
model = Sequential()
model.add(LSTM(50,
batch_input_shape=(cfg_batch_size, cfg_t_step, 1),
return_sequences=True,
stateful=True))
model.add(LSTM(50,
batch_input_shape=(cfg_batch_size, cfg_t_step, 1),
return_sequences=False,
stateful=True))
model.add(Dense(1))
model.compile(loss='mse', optimizer='rmsprop')
model.fit(X, y, batch_size=cfg_batch_size, verbose=2, validation_split=0.25, nb_epoch=1, shuffle=False)