When conducting experiments, first test baseline, ideas generated during the experiment can be considered the first experiment on the baseline. If you really can bring some improvement to the baseline of performance, then we can be transplanted to our current ideas already designed the new structure.
Python memory management mechanism
When the output of the network to extract the intermediate layer, so as not to retain the intermediate member variable output network (i.e. __init__ function) in which class should be considered to retain the forward function class.
