mac安装scrapy并创建项目的实例讲解_Python

mac安装scrapy并创建项目的实例讲解

2021-03-04 00:19蜡笔小心丶 Python

今天小编就为大家分享一篇mac安装scrapy并创建项目的实例讲解，具有很好的参考价值，希望对大家有所帮助。一起跟随小编过来看看吧

最近刚好在学习python+scrapy的爬虫技术，因为mac是自带python2.7的，所以安装3.5版本有两种方法，一种是升级，一种是额外安装3.5版本。

升级就不用说了，讲讲额外安装的版本吧~~~

因为python是有自带版本的，最开始安装的时候都会有一种“ 会不会冲突 ”的感觉。

其实安装3.5版本也就是在官网上直接下载之后安装，和普通的mac软件安装方式是一样的~~

https://www.python.org/downloads/release/python-353/

安装完成之后，不会覆盖原来的python，会在 /Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5文件中

在终端直接输入 python 会执行python2.7版本

									python 

									Python 2.7.12 (default, Jun 29 2016, 14:05:02) 

									[GCC 4.2.1 Compatible Apple LLVM 7.3.0 (clang-703.0.31)] on darwin 

									Type "help", "copyright", "credits" or "license" for more information. 

									>>>

在终端直接输入 python3 则会执行python3.5版本

									python3 

									Python 3.5.3 (v3.5.3:1880cb95a742, Jan 16 2017, 08:49:46) 

									[GCC 4.2.1 (Apple Inc. build 5666) (dot 3)] on darwin 

									Type "help", "copyright", "credits" or "license" for more information. 

									>>>

接下来就可以开始安装scrapy了

python3.5中会自带 pip，所以不需要额外安装了，可以直接在终端输入 pip3 --version查看版本和路径

									pip3 --version 

									pip 9.0.1 from /Library/Frameworks/Python.framework/Versions/3.5/lib/python3.5/site-packages (python 3.5)

使用 pip3 安装scrapy

1	`pip3 install Scrapy`

这里的Scrapy一定要首字母大写，不然会在安装的过程中报错~~

									Collecting scrapy

									 Retrying (Retry(total=4, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x103aa2c88>: Failed to establish a new connection: [Errno 61] Connection refused',)': /simple/scrapy/

									 Retrying (Retry(total=3, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x103aa29e8>: Failed to establish a new connection: [Errno 61] Connection refused',)': /simple/scrapy/

									 Retrying (Retry(total=2, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x103aa2630>: Failed to establish a new connection: [Errno 61] Connection refused',)': /simple/scrapy/

									 Retrying (Retry(total=1, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x103aa2f28>: Failed to establish a new connection: [Errno 61] Connection refused',)': /simple/scrapy/

									 Retrying (Retry(total=0, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x103aa2be0>: Failed to establish a new connection: [Errno 61] Connection refused',)': /simple/scrapy/

									 Could not find a version that satisfies the requirement scrapy (from versions: )

									No matching distribution found for scrapy

安装成功之后，可以直接在终端上输入 scrapy 查看版本号及使用

									Scrapy 1.4.0 - no active project

									Usage:

									 scrapy <command> [options] [args]

									Available commands:

									 bench   Run quick benchmark test

									 fetch   Fetch a URL using the Scrapy downloader

									 genspider  Generate new spider using pre-defined templates

									 runspider  Run a self-contained spider (without creating a project)

									 settings  Get settings values

									 shell   Interactive scraping console

									 startproject Create new project

									 version  Print Scrapy version

									 view   Open URL in browser, as seen by Scrapy

									 [ more ]  More commands available when run from project directory

									Use "scrapy <command> -h" to see more info about a command