知识点

Traceback (most recent call last):

File "/usr/bin/scrapy", line 7, in <module>

from scrapy.cmdline import execute

File "/usr/lib64/python2.7/site-packages/scrapy/cmdline.py", line 9, in <module>

from scrapy.crawler import CrawlerProcess

File "/usr/lib64/python2.7/site-packages/scrapy/crawler.py", line 7, in <module>

from twisted.internet import reactor, defer

File "/usr/lib64/python2.7/site-packages/twisted/internet/reactor.py", line 38, in <module>

from twisted.internet import default

File "/usr/lib64/python2.7/site-packages/twisted/internet/default.py", line 56, in <module>

install = \_getInstallFunction\(platform\)

File "/usr/lib64/python2.7/site-packages/twisted/internet/default.py", line 44, in _getInstallFunction

from twisted.internet.epollreactor import install

File "/usr/lib64/python2.7/site-packages/twisted/internet/epollreactor.py", line 24, in <module>

from twisted.internet import posixbase

File "/usr/lib64/python2.7/site-packages/twisted/internet/posixbase.py", line 18, in <module>

from twisted.internet import error, udp, tcp

File "/usr/lib64/python2.7/site-packages/twisted/internet/tcp.py", line 28, in <module>

from twisted.internet.\_newtls import \(

File "/usr/lib64/python2.7/site-packages/twisted/internet/_newtls.py", line 21, in <module>

from twisted.protocols.tls import TLSMemoryBIOFactory, TLSMemoryBIOProtocol

File "/usr/lib64/python2.7/site-packages/twisted/protocols/tls.py", line 63, in <module>

from twisted.internet.\_sslverify import \_setAcceptableProtocols

File "/usr/lib64/python2.7/site-packages/twisted/internet/_sslverify.py", line 38, in <module>

TLSVersion.TLSv1\_1: SSL.OP\_NO\_TLSv1\_1,

AttributeError: 'module' object has no attribute 'OP_NO_TLSv1_1

看看 pip install scrapy需要的 pyopenssl twisted 等和你安装的版本一样么我的就是因为TWist 版本高于需要的

用pip install twisted==13.1.0 才成功

linux下递归删除目录下所有exe文件

今天给学校部署校庆网站，做网站的同学传给我的网站文件夹里，有很多exe文件，而且这些exe的文件名都是原来的目录名，看起来是他的机器中了病毒。虽然exe文件在linux下无法运行，但是还是要删除这些exe文件。

在网上找了一下，《linux下递归删除某个文件夹或文件》给了我满意的方法，让我可以一次性删除某目录及其子目录下所有的exe文件。

find . -name '*.exe' -type f -print -exec rm -rf {} \;
(1) "." 表示从当前目录开始递归查找

(2) “ -name '*.exe' "根据名称来查找，要查找所有以.exe结尾的文件夹或者文件

(3) " -type f "查找的类型为文件

(4) "-print" 输出查找的文件目录名

(5) 最主要的是是-exec了，-exec选项后边跟着一个所要执行的命令，表示将find出来的文件或目录执行该命令。

 exec选项后面跟随着所要执行的命令或脚本，然后是一对儿{}，一个空格和一个\，最后是一个分号

案例

删除所有的.pyc文件

find . -name '*.pyc' -exec rm -rf {} \;

Scrapyd指定版本号

默认情况下, scrapyd-deploy使用当前的时间戳作为版本号，我们可以使用--version来指定版本号

scrapyd-deploy <target> -p <project> --version <version>

版本号的格式必须满足LooseVersion

    1.5.1
    1.5.2b2
    161
    3.10a
    8.02
    3.4j
    1996.07.12
    3.2.pl0
    3.1.1.6
    2g6
    11g
    0.960923
    2.2beta29
    1.13++
    5.5.kw

如：设置版本号为0.1

scrapyd-deploy tutorial_deploy -p tutorial --version 0.1
Packing version 0.1
Deploying to project "tutorial" in http://192.168.17.129:6800/addversion.json
Server response (200):
{"status": "ok", "project": "tutorial", "version": "0.1", "spiders": 2, "node_name": "ubuntu"}

如果使用了Git管理代码，可以使用GIT作为version的参数，也可以将它写入scrapy.cfg文件，那么就会使用当前的reversion作为版本号。

[deploy:target]
...
version = GIT

编辑文件：scrapy.cfg

[deploy:tutorial_deploy]
url = http://192.168.17.129:6800/
project = tutorial
username = enlong
password = test
version = GIT

当前版本号为r7-master

scrapyd-deploy tutorial_deploy -p tutorial
fatal: No names found, cannot describe anything.
Packing version r7-master
Deploying to project "douban-movies" in http://localhost:6800/addversion.json
Server response (200):
{"status": "ok", "project": "douban-movies", "version": "r7-master", "spiders": 1, "node_name": "sky"}