Memory Consumption on Decode side

[danielpeintner]

#20 showed that on decoder side memory consumption is higher than on encoder side. Look into that issue more closely and check whether this situation can be improved.