Repository navigation
Replies: 4 comments 3 replies
|
You can enqueue it again with a different |
I am afraid this is not possible.
You can use the request = Request.from_url('https://crawlee.dev/', always_enqueue=True)which will generate "unique" |
|
Actually, I think you can do this: request = Request.from_url('https://crawlee.dev/', always_enqueue=True)
request.max_retries = failed_request.max_retries - 1 # TODO check if this is not negative
await queue.add_request(request)It does not enqueue the same request per se, but it's close enough if you copy relevant parameters. |
|
Thank you for the helpful answer. |
|
I searched the documentation but couldn’t find an example of ‘await queue.add_request(request)’, so I’m unsure how to import or instantiate ‘queue’. Nothing breaks when I try the following—would this be considered acceptable? |
|
Yes, this is a reasonable way to enqueue new requests |
I am afraid this is not possible.
You can use the
always_enqueue=True:which will generate "unique"
unique_keyunder the hood. And add the request to the request queue.