خرید بک لینک

Vote count: 0

I am using Scrapy 1.1, my question is:

After using start_requests() to make urls,start_urls is also necessary?
Can I delete it?

For example:

class demoSpider(RedisSpider):
    name = "demospider"

    redis_key = 'demospider:start_urls'
    start_urls = ['http://www.example.com']

    def start_requests(self):
        pages=[]
        for i in range(1,10):
            url='http://www.example.com/?page=%s'%i
            page=scrapy.Request(url)
            pages.append(page)
        retu pages

asked 26 secs ago

برچسب: نویسنده: استخدام کار تاريخ: يکشنبه 13 تير 1395 ساعت: 0:59

صفحه بندی