Standard Input Pruning

• Train Neural Network
• Rank inputs by Feature Importance
• Prune lower ranked inputs
• Store the model with its validation score
• Repeat until no weights left
• Choose best model

Also see Reverse Input Pruning