I have a problem where in spark streaming i am only conceed about last 1 minute so I have written my code accordingly
Now sometime due to various resource my scheduled batched got piled up like this
INFO JobScheduler: Added jobs for time 1470046240000 ms
INFO JobScheduler: Added jobs for time 1470046241000 ms
INFO JobScheduler: Added jobs for time 1470046242000 ms
INFO JobScheduler: Added jobs for time 1470046243000 ms
My question is how can I drop the schedule jobs if time exceed 1 minute so that they can be discarded before execution