Reverse Input Pruning

• Train Neural Network
• Rank inputs by Feature Importance
• Prune important ranked inputs
• Store the important inputs and create model with them
• Repeat until created model reaches desired validation score or gets worse

Also see Standard Input Pruning.