Improvements & a LOT of waiting.
Optimized the 1D CNN
- changed optimizer from default ADAM to tf.keras.optimizers.Adam(learning_rate=1e-4)
- increased batch_size from 32 to 64
- Added ReduceLROnPlateu callback
Why: The training curves showed early-epoch instability and chaos. Lowering to 1e^-4 should smooth out the convergence.
Larger batches provide a more stable gradient estimade, reducing noise
ReduceLROnPlateu allows the model to automatically lower the learning rate further if the validation loss plateus. Help to settle in a more optimal local minimum
Now I’m just waiting, it’s been 3 hours, but I have only downloaded ~2/3 of both Confirmed and Negative datasets.
Comments 0
No comments yet. Be the first!
Sign in to join the conversation.