Vote count: 0 I have a similar problem than MobileFirst Direct update customization using adapter But I'm not using the Adapter to modify the DirectUpdate, I'm trying to make a record about the state of the DirectUpdate when it finish, but seems that the call to the adapter not works. There is any restriction to call WL.Client.invokeProcedure on main.js after the DirectUpdate finish? asked 7 mins agoDaniel Contreras Aladro Let's block ads! بخوانید...
ادامه مطلبVote count: 0 I've got a set of 25,000+ urls that I need to scrape. I'm consistently seeing that after about 22,000 urls the crawl rate drops drastically. Take a look at these log lines to get some perspective: 2016-04-18 00:14:06 [scrapy] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2016-04-18 00:15:06 [scrapy] INFO: Crawled 5324 pages (at 5324 pages/min), scraped 0 items (at 0 items/min) 2016-04-18 00:16:06 [scrapy] INFO: Crawled 9475 pages (at 4151 pages/min), scraped 0 items (at 0 items/min) 2016-04-18 00:17:06 [scrapy] INFO: Crawled 14416 pages (at 4941 pages/min), scraped 0 items (at 0 items/min) 2016-04-18 00:18:07 [scrapy] INFO: Crawled 20575 pages (at 615...
ادامه مطلب