- Add
scrapyd-client targets
subcommand. scrapyd-client
can be called aspython -m scrapyd_client
.- Add support for Python 3.12.
Changes to commands:
- BREAKING CHANGE:
scrapyd-client
subcommands accept the--target
(-t
) option, not thescrapyd-client
command. The target is the name of a target in thescrapy.cfg
file, likescrapyd-deploy
, instead of a URL. - BREAKING CHANGE:
scrapyd-client
raises an error if no Scrapy project is found, likescrapyd-deploy
, instead of assuming a target athttp://localhost:6800
. - The
scrapyd-client schedule
subcommand accepts multiple--arg setting=...
arguments. (@mxdev88) - The
scrapyd_client.ScrapyClient.schedule
methods acceptargs
as a list, instead of as a dict. - The
scrapyd-deploy --debug
option prints the subprocess' standard output and standard error, instead of writing tostdout
andstderr
files.
Changes to modules:
- BREAKING CHANGE: Move exceptions from
scrapyd_client.utils
toscrapyd_client.exceptions
. - BREAKING CHANGE: Move
DEFAULT_TARGET_URL
andHEADERS
fromscrapyd_client.utils
toscrapyd_client.pyclient
. - BREAKING CHANGE: Merge
scrapyd_client.commands
andscrapyd_client.cli
intoscrapyd_client.__main__
.
- Run
clean
separately from building the egg. (Setuptools caches the Python packages from beforeclean
runs.) - Add
pip
requirement foruberegg
.
- BREAKING CHANGE: Remove the
scrapyd-client --username
(-u
) and--password
(-p
) options, in favor of using thescrapy.cfg
file. - BREAKING CHANGE: Remove the
scrapyd-deploy --list-targets
(-l
) option, in favor ofscrapyd-client targets
. - BREAKING CHANGE: Remove the
scrapyd-deploy --list-projects
(-L
) option, in favor ofscrapyd-client projects
. - BREAKING CHANGE: Remove the
get_request
andpost_request
functions fromscrapyd_client.utils
. - BREAKING CHANGE: Remove the
scrapyd_client.lib
module, in favor ofscrapyd_client.ScrapydClient
. - Remove
urllib3
andw3lib
requirements. - Drop support for Python 3.7, 3.8.
- Add
scrapyd-client --username
and--password
options. (@mxdev88) - Add
ScrapydClient
, a Python client to interact with Scrapyd. (@mxdev88) - Expand environment variables in the
scrapy.cfg
file. (@mxdev88) - Add support for Python 3.10, 3.11. (@Laerte)
- Fix
FileNotFoundError
when usingscrapyd-deploy --deploy-all-targets
.
- Add
scrapyd-deploy --include-dependencies
option to install project dependencies from arequirements.txt
file. (@mxdev88)
- Remove temporary directories created by
scrapyd-deploy --deploy-all-targets
. - Address
w3lib
deprecation warning, by addingurllib3
requirement. - Address Python deprecation warnings.
- Add support for Scrapy 2.5.
- Add support for Python 3.7, 3.8, 3.9, PyPy3.7.
- Remove
scrapyd_client.utils.get_config
, which was a compatibility wrapper for Python 2.7. - Drop support for Python 2.7, 3.4, 3.5.
- Add
scrapyd-client
console script withdeploy
,projects
,spiders
andschedule
subcommands. - Install
scrapyd-deploy
as a console script.
- Add
scrapyd-deploy --deploy-all-targets
(-a
) option to deploy to all targets. - Add support for Python 3.
- Fix returncode on egg deploy error.
- Drop support for Python 2.6.
Initial release.