Global Module Index

S
 
S
scrapy
    scrapy.conf Settings manager
    scrapy.contrib.closespider Close spider extension
    scrapy.contrib.corestats.corestats Core stats collection
    scrapy.contrib.debug Extensions for debugging Scrapy
    scrapy.contrib.downloadermiddleware
    scrapy.contrib.downloadermiddleware.cookies Cookies Downloader Middleware
    scrapy.contrib.downloadermiddleware.defaultheaders Default Headers Downloader Middleware
    scrapy.contrib.downloadermiddleware.httpauth HTTP Auth downloader middleware
    scrapy.contrib.downloadermiddleware.httpcache HTTP Cache downloader middleware
    scrapy.contrib.downloadermiddleware.httpcompression Http Compression Middleware
    scrapy.contrib.downloadermiddleware.httpproxy Http Proxy Middleware
    scrapy.contrib.downloadermiddleware.redirect Redirection Middleware
    scrapy.contrib.downloadermiddleware.retry Retry Middleware
    scrapy.contrib.downloadermiddleware.robotstxt robots.txt middleware
    scrapy.contrib.downloadermiddleware.stats Downloader Stats Middleware
    scrapy.contrib.downloadermiddleware.useragent User Agent Middleware
    scrapy.contrib.exporter Item Exporters
    scrapy.contrib.exporter.jsonlines JsonLines Item Exporter
    scrapy.contrib.linkextractors Link extractors classes
    scrapy.contrib.linkextractors.sgml SGMLParser-based link extractors
    scrapy.contrib.loader Item Loader class
    scrapy.contrib.loader.processor A collection of processors to use with Item Loaders
    scrapy.contrib.memdebug Memory debugger extension
    scrapy.contrib.memusage Memory usage extension
    scrapy.contrib.pipeline Item Pipeline manager and built-in pipelines
    scrapy.contrib.pipeline.fileexport
    scrapy.contrib.pipeline.images Images Pipeline
    scrapy.contrib.schedulermiddleware
    scrapy.contrib.schedulermiddleware.duplicatesfilter Duplicates Filter Scheduler Middleware
    scrapy.contrib.spidermiddleware
    scrapy.contrib.spidermiddleware.depth Depth Spider Middleware
    scrapy.contrib.spidermiddleware.httperror HTTP Error Spider Middleware
    scrapy.contrib.spidermiddleware.offsite Offiste Spider Middleware
    scrapy.contrib.spidermiddleware.referer Referer Spider Middleware
    scrapy.contrib.spidermiddleware.requestlimit Request limit Spider Middleware
    scrapy.contrib.spidermiddleware.urlfilter URL Filter Spider Middleware
    scrapy.contrib.spidermiddleware.urllength URL Length Spider Middleware
    scrapy.contrib.spiders Collection of generic spiders
    scrapy.contrib.statsmailer StatsMailer extension
    scrapy.contrib.webconsole Contains most built-in web console extensions
    scrapy.contrib.webconsole.enginestatus Engine status web console extension
    scrapy.contrib.webconsole.livestats Spider live stats web console extension
    scrapy.contrib.webconsole.scheduler Scheduler queue web console extension
    scrapy.contrib.webconsole.stats Stats dump web console extension
    scrapy.core.exceptions Core exceptions
    scrapy.core.signals Signals definitions
    scrapy.extension The extension manager
    scrapy.http Request and Response classes
    scrapy.item Item and Field classes
    scrapy.log Logging facility
    scrapy.mail Helpers to easily send e-mail.
    scrapy.management.telnet The Telnet Console
    scrapy.management.web Web management console
    scrapy.selector XPath selectors classes
    scrapy.spider Spiders base class, spider manager and spider middleware
    scrapy.stats.collector Basic Stats Collectors
    scrapy.stats.collector.simpledb Simpledb Stats Collector
    scrapy.stats.signals Stats Collector signals
    scrapy.utils.trackref Track references of live objects