Informer模型调研报告
目录
1. 背景与综述...........................................................................................................................................3
2. Embedding 层.......................................................................................................................................5
2.1. Transformer 的 Embedding 层...................................................................................................5
2.2. Informer 的 Embedding 层.........................................................................................................5
3. Attention............................................................................................................................................... 6
3.1. Transformer 的 Attention........................................................................................................... 6
3.2. Informer 的 ProbAttention......................................................................................................... 9
4. Encoder 与 Decoder...........................................................................................................................10
4.1. Encoder.....................................................................................................................................10
4.2. Decoder.....................................................................................................................................11
5. 总结与展望.........................................................................................................................................12
