Skip to content

dongfanliang/pycurl

 
 

Repository files navigation

PycURL -- A Python Interface To The cURL library

image

PycURL is a Python interface to libcurl, the multiprotocol file transfer library. Similarly to the urllib Python module, PycURL can be used to fetch objects identified by a URL from a Python program. Beyond simple fetches however PycURL exposes most of the functionality of libcurl, including:

  • Speed - libcurl is very fast and PycURL, being a thin wrapper above libcurl, is very fast as well. PycURL was benchmarked to be several times faster than requests.
  • Features including multiple protocol support, SSL, authentication and proxy options. PycURL supports most of libcurl's callbacks.
  • Multi and share interfaces.
  • Sockets used for network operations, permitting integration of PycURL into the application's I/O loop (e.g., using Tornado).

Requirements

  • Python 2.6, 2.7 or 3.1 through 3.5.
  • libcurl 7.19.0 or better.

Installation

Please see INSTALL.rst for installation instructions. If installing from a Git checkout, please follow instruction in the "Git Checkout" section of INSTALL.rst.

Support

For support questions, please use curl-and-python mailing list. Mailing list archives are available for your perusal as well.

Although not an official support venue, Stack Overflow has been popular with PycURL users as well.

Bugs can be reported via GitHub. Please only use GitHub issues when you are certain you have found a bug in PycURL. If you do not have a patch to fix the bug, or at least a specific code fragment in PycURL that you believe is the cause, you should instead post your inquiry to the mailing list.

Documentation

Documentation for the most recent PycURL release is available on PycURL website.

To build documentation from source, run make docs. Building documentation requires Sphinx to be installed, as well as pycurl extension module built as docstrings are extracted from it. Built documentation is stored in build/doc subdirectory.

Automated Tests

PycURL comes with an automated test suite. To run the tests, execute:

make test

The suite depends on packages nose and bottle, as well as vsftpd.

Some tests use vsftpd configured to accept anonymous uploads. These tests are not run by default. As configured, vsftpd will allow reads and writes to anything the user running the tests has read and write access. To run vsftpd tests you must explicitly set PYCURL_VSFTPD_PATH variable like so:

# use vsftpd in PATH
export PYCURL_VSFTPD_PATH=vsftpd

# specify full path to vsftpd
export PYCURL_VSFTPD_PATH=/usr/local/libexec/vsftpd

Test Matrix

The test matrix is a separate framework that runs tests on more esoteric configurations. It supports:

  • Testing against Python 2.4, which bottle does not support.
  • Testing against Python compiled without threads, which requires an out of process test server.
  • Testing against locally compiled libcurl with arbitrary options.

To use the test matrix, first start the test server from Python 2.5+ by running:

python -m tests.appmanager

Then in a different shell, and preferably in a separate user account, run the test matrix:

# run ftp tests, etc.
export PYCURL_VSFTPD_PATH=vsftpd
# create a new work directory, preferably not under pycurl tree
mkdir testmatrix
cd testmatrix
# run the matrix specifying absolute path
python /path/to/pycurl/tests/matrix.py

The test matrix will download, build and install supported Python versions and supported libcurl versions, then run pycurl tests against each combination. To see what the combinations are, look in tests/matrix.py.

Contribute

For smaller changes:

  1. Fork the repository on Github.
  2. Create a branch off master.
  3. Make your changes.
  4. Write a test which shows that the bug was fixed or that the feature works as expected.
  5. Send a pull request.
  6. Check back after 10-15 minutes to see if tests passed on Travis CI. PycURL supports old Python and libcurl releases and their support is tested on Travis.

For larger changes:

  1. Join the mailing list.
  2. Discuss your proposal on the mailing list.
  3. When consensus is reached, implement it as described above.

Please contribute binary distributions for your system to the downloads repository.

License

Copyright (C) 2001-2008 by Kjetil Jacobsen <kjetilja at gmail.com>
Copyright (C) 2001-2008 by Markus F.X.J. Oberhumer <markus at oberhumer.com>
Copyright (C) 2013-2016 by Oleg Pudeyev <oleg at bsdpower.com>

All rights reserved.

PycURL is dual licensed under the LGPL and an MIT/X derivative license
based on the cURL license.  A full copy of the LGPL license is included
in the file COPYING-LGPL.  A full copy of the MIT/X derivative license is
included in the file COPYING-MIT.  You can redistribute and/or modify PycURL
according to the terms of either license.

About

PycURL - Python interface to libcurl

Resources

License

LGPL-2.1, Unknown licenses found

Licenses found

LGPL-2.1
COPYING-LGPL
Unknown
COPYING-MIT

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 51.3%
  • C 42.1%
  • Shell 2.5%
  • PHP 2.1%
  • Makefile 1.2%
  • ApacheConf 0.8%