Request fingerprinting parameters
The request fingerprinter class of scrapy-zyte-api generates request fingerprints for Zyte API requests based on the following Zyte API parameters:
-
For URLs that include a URL fragment, like
https://example.com#foo
, URL canonicalization keeps the URL fragment if browserHtml or screenshot are enabled, or if extractFrom is set tobrowserHtml
. Request attribute parameters (httpRequestBody, httpRequestText, httpRequestMethod), except headers
Equivalent httpRequestBody and httpRequestText values generate the same signature.
Output parameters (browserHtml, httpResponseBody, httpResponseHeaders, responseCookies, screenshot, and automatic extraction outputs like product)
Rendering option parameters (actions, device, javascript, screenshotOptions, viewport, and automatic extraction options like productOptions)
The following Zyte API parameters are not taken into account for request fingerprinting:
Request header parameters (customHttpRequestHeaders, requestHeaders)
Request cookie parameters (cookieManagement, requestCookies)
Session handling parameters (sessionContext, sessionContextParameters)
Experimental parameters (experimental.*)