Mac – 📔独行看客的笔记本

「记录」制作macOS High Sierra 10.13.6的ISO安装镜像

薛定谔的nil2018年10月3日 0 Comments

　　最近掏了一个dell 9020sff，心血来潮想要装mac虚拟机，但是折腾了好久总是出各种奇怪的问题，后来还是在一个台湾的博客里找到解决方法，在这记录一下。废话不多说，先上干货。

制作macOS High Sierra 10.13.6的ISO安装镜像

　　首先准备好一个mac系统，不管是实体mac还是mac虚拟机都行，甚至比较老的OS X也行（我用的10.8，虽然官方说这个版本支持升级到10.13，但从store下载的原版app在10.8里提示已损坏无法打开，但这并不影响iso的制作）。然后需要下载好10.13的安装应用，建议从mac app store下载，把app放在应用程序目录。

注意：下面的代码中默认的10.13安装app路径是：”/Applications/Install\ macOS\ High\ Sierra.app”，如果你的安装app不在默认位置，请自行替换路径。

hdiutil attach /Applications/Install\ macOS\ High\ Sierra.app/Contents/SharedSupport/InstallESD.dmg -noverify -mountpoint /Volumes/highsierra
hdiutil create -o /tmp/HighSierraBase.cdr -size 7316m -layout SPUD -fs HFS+J
hdiutil attach /tmp/HighSierraBase.cdr.dmg -noverify -mountpoint /Volumes/install_build
asr restore -source /Applications/Install\ macOS\ High\ Sierra.app/Contents/SharedSupport/BaseSystem.dmg -target /Volumes/install_build -noprompt -noverify -erase
# 注意，下面这一条命令会报一些文件或目录不存在的警告，但这是正常的
cp -R /Volumes/highsierra/Packages /Volumes/OS\ X\ Base\ System/System/Installation
hdiutil detach /Volumes/OS\ X\ Base\ System/
hdiutil detach /Volumes/highsierra/
mv /tmp/HighSierraBase.cdr.dmg /tmp/BaseSystem.dmg
hdiutil create -o /tmp/HighSierra.cdr -size 8965m -layout SPUD -fs HFS+J
hdiutil attach /tmp/HighSierra.cdr.dmg -noverify -mountpoint /Volumes/install_build
asr restore -source /Applications/Install\ macOS\ High\ Sierra.app/Contents/SharedSupport/BaseSystem.dmg -target /Volumes/install_build -noprompt -noverify -erase
cp /tmp/BaseSystem.dmg /Volumes/OS\ X\ Base\ System
hdiutil detach /Volumes/OS\ X\ Base\ System/
hdiutil convert /tmp/HighSierra.cdr.dmg -format UDTO -o /tmp/HighSierra.iso
mv /tmp/HighSierra.iso.cdr ~/Desktop/Install\ macOS\ High\ Sierra.iso
rm /tmp/HighSierra.cdr.dmg

hdiutil attach /Applications/Install\ macOS\ High\ Sierra.app/Contents/SharedSupport/InstallESD.dmg -noverify -mountpoint /Volumes/highsierra

hdiutil create -o /tmp/HighSierraBase.cdr -size 7316m -layout SPUD -fs HFS+J

hdiutil attach /tmp/HighSierraBase.cdr.dmg -noverify -mountpoint /Volumes/install_build

asr restore -source /Applications/Install\ macOS\ High\ Sierra.app/Contents/SharedSupport/BaseSystem.dmg -target /Volumes/install_build -noprompt -noverify -erase

# 注意，下面这一条命令会报一些文件或目录不存在的警告，但这是正常的

cp -R /Volumes/highsierra/Packages /Volumes/OS\ X\ Base\ System/System/Installation

hdiutil detach /Volumes/OS\ X\ Base\ System/

hdiutil detach /Volumes/highsierra/

mv /tmp/HighSierraBase.cdr.dmg /tmp/BaseSystem.dmg

hdiutil create -o /tmp/HighSierra.cdr -size 8965m -layout SPUD -fs HFS+J

hdiutil attach /tmp/HighSierra.cdr.dmg -noverify -mountpoint /Volumes/install_build

asr restore -source /Applications/Install\ macOS\ High\ Sierra.app/Contents/SharedSupport/BaseSystem.dmg -target /Volumes/install_build -noprompt -noverify -erase

cp /tmp/BaseSystem.dmg /Volumes/OS\ X\ Base\ System

hdiutil detach /Volumes/OS\ X\ Base\ System/

hdiutil convert /tmp/HighSierra.cdr.dmg -format UDTO -o /tmp/HighSierra.iso

mv /tmp/HighSierra.iso.cdr ~/Desktop/Install\ macOS\ High\ Sierra.iso

rm /tmp/HighSierra.cdr.dmg

　　如果没有意外，你就可以在桌面找到iso安装镜像了。

参考资料：製作 macOS High Sierra 10.13 的可開機安裝隨身碟及 ISO 映像檔

神奇的坑

　　在找到正确的解决方法之前，我当然也踩了不少坑，一度甚至想放弃，但「缘，妙不可言！」，所以在这记录一些比较神奇的坑。

1、用官方推荐的createinstallmedia创建的dmg，用磁盘工具另存为“DVD/CD 主映像”，会储存为.cdr文件，但这个文件不能直接改后缀成.iso！

　　直接改后缀看似没有什么问题，在win里也能打开，也可以在esxi里挂载，但是在安装中要么无法引导，要么在引导的最后阶段出现禁止符号！！！没错，就是这个符号🚫。黑色的背景，白色的禁止符，我一直以为是我虚拟机的问题，废了好大劲才晓得是镜像问题。

2、不可以在mac以外的系统里将dmg或cdr转为iso，不管用什么工具都不行，必须用mac！

　　我试过百度上几乎所有的转换方案，包括软碟通啊，或是什么其他的软件，最后事实证明，都TMD在骗人，浪费我的时间和精力！SB百度！

3、VMware虚拟macOS需要加两个高级参数

有两个修改方法。第一个是直接改vmx文件，另一个是在vsphere client里“编辑虚拟机设置”，“虚拟机选项”选项卡，展开“高级”，点“编辑配置”。确保下面两个参数正确，否则无法打开虚拟机，或运行出现奇怪的错误。

smc.present = “TRUE”
smc.version = 0

在Mac中用pip安装Scrapy

薛定谔的nil2016年2月11日 0 Comments

遇到了两个大问题，第一个在这里已经解决。

第二个问题是：

creating build/temp.macosx-10.11-intel-2.7/src/lxml
cc -fno-strict-aliasing -fno-common -dynamic -arch x86_64 -arch i386 -g -Os -pipe -fno-common -fno-strict-aliasing -fwrapv -DENABLE_DTRACE -DMACOSX -DNDEBUG -Wall -Wstrict-prototypes -Wshorten-64-to-32 -DNDEBUG -g -fwrapv -Os -Wall -Wstrict-prototypes -DENABLE_DTRACE -arch x86_64 -arch i386 -pipe -I/usr/include/libxml2 -Isrc/lxml/includes -I/System/Library/Frameworks/Python.framework/Versions/2.7/include/python2.7 -c src/lxml/lxml.etree.c -o build/temp.macosx-10.11-intel-2.7/src/lxml/lxml.etree.o -w -flat_namespace
In file included from src/lxml/lxml.etree.c:323:
src/lxml/includes/etree_defs.h:14:10: fatal error: 'libxml/xmlversion.h' file not found
#include "libxml/xmlversion.h"
^
1 error generated.
Compile failed: command 'cc' failed with exit status 1
creating tmp
cc -I/usr/include/libxml2 -I/usr/include/libxml2 -c /tmp/xmlXPathInitb43sL5.c -o tmp/xmlXPathInitb43sL5.o
/tmp/xmlXPathInitb43sL5.c:1:10: fatal error: 'libxml/xpath.h' file not found
#include "libxml/xpath.h"
^
1 error generated.
*********************************************************************************
Could not find function xmlCheckVersion in library libxml2. Is libxml2 installed?
Perhaps try: xcode-select --install
*********************************************************************************
error: command 'cc' failed with exit status 1

----------------------------------------
Command "/usr/bin/python -u -c "import setuptools, tokenize;__file__='/private/tmp/pip-build-PmvVPX/lxml/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-uPgqEz-record/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /private/tmp/pip-build-PmvVPX/lxml

creating build/temp.macosx-10.11-intel-2.7/src/lxml

cc -fno-strict-aliasing -fno-common -dynamic -arch x86_64 -arch i386 -g -Os -pipe -fno-common -fno-strict-aliasing -fwrapv -DENABLE_DTRACE -DMACOSX -DNDEBUG -Wall -Wstrict-prototypes -Wshorten-64-to-32 -DNDEBUG -g -fwrapv -Os -Wall -Wstrict-prototypes -DENABLE_DTRACE -arch x86_64 -arch i386 -pipe -I/usr/include/libxml2 -Isrc/lxml/includes -I/System/Library/Frameworks/Python.framework/Versions/2.7/include/python2.7 -c src/lxml/lxml.etree.c -o build/temp.macosx-10.11-intel-2.7/src/lxml/lxml.etree.o -w -flat_namespace

In file included from src/lxml/lxml.etree.c:323:

src/lxml/includes/etree_defs.h:14:10: fatal error: 'libxml/xmlversion.h' file not found

#include "libxml/xmlversion.h"

1 error generated.

Compile failed: command 'cc' failed with exit status 1

creating tmp

cc -I/usr/include/libxml2 -I/usr/include/libxml2 -c /tmp/xmlXPathInitb43sL5.c -o tmp/xmlXPathInitb43sL5.o

/tmp/xmlXPathInitb43sL5.c:1:10: fatal error: 'libxml/xpath.h' file not found

#include "libxml/xpath.h"

1 error generated.

*********************************************************************************

Could not find function xmlCheckVersion in library libxml2. Is libxml2 installed?

Perhaps try: xcode-select --install

*********************************************************************************

error: command 'cc' failed with exit status 1

----------------------------------------

Command "/usr/bin/python -u -c "import setuptools, tokenize;__file__='/private/tmp/pip-build-PmvVPX/lxml/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /tmp/pip-uPgqEz-record/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /private/tmp/pip-build-PmvVPX/lxml

我使用了这个文章里的解决办法：

MacBook-Pro:~ EverybodyLies$ sudo STATIC_DEPS=true pip install lxml
Password:
The directory '/Users/EverybodyLies/Library/Caches/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
The directory '/Users/EverybodyLies/Library/Caches/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
Collecting lxml
Downloading lxml-3.5.0.tar.gz (3.8MB)
100% |████████████████████████████████| 3.8MB 120kB/s
Installing collected packages: lxml
Running setup.py install for lxml ... done
Successfully installed lxml-3.5.0

MacBook-Pro:~ EverybodyLies$ sudo STATIC_DEPS=true pip install lxml

Password:

The directory '/Users/EverybodyLies/Library/Caches/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.

The directory '/Users/EverybodyLies/Library/Caches/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.

Collecting lxml

Downloading lxml-3.5.0.tar.gz (3.8MB)

100% |████████████████████████████████| 3.8MB 120kB/s

Installing collected packages: lxml

Running setup.py install for lxml ... done

Successfully installed lxml-3.5.0

成功安装lxml后，再运行：

MacBook-Pro:~ EverybodyLies$ sudo pip install Scrapy
The directory '/Users/EverybodyLies/Library/Caches/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
The directory '/Users/EverybodyLies/Library/Caches/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
Collecting Scrapy
Downloading Scrapy-1.0.5-py2-none-any.whl (291kB)
100% |████████████████████████████████| 294kB 257kB/s
Requirement already satisfied (use --upgrade to upgrade): cssselect>=0.9 in /Library/Python/2.7/site-packages (from Scrapy)
Requirement already satisfied (use --upgrade to upgrade): queuelib in /Library/Python/2.7/site-packages (from Scrapy)
Requirement already satisfied (use --upgrade to upgrade): pyOpenSSL in /Library/Python/2.7/site-packages (from Scrapy)
Requirement already satisfied (use --upgrade to upgrade): w3lib>=1.8.0 in /Library/Python/2.7/site-packages (from Scrapy)
Requirement already satisfied (use --upgrade to upgrade): lxml in /Library/Python/2.7/site-packages (from Scrapy)
Collecting Twisted>=10.0.0 (from Scrapy)
Downloading Twisted-15.5.0.tar.bz2 (3.1MB)
100% |████████████████████████████████| 3.1MB 105kB/s
Requirement already satisfied (use --upgrade to upgrade): six>=1.5.2 in /Library/Python/2.7/site-packages (from Scrapy)
Requirement already satisfied (use --upgrade to upgrade): service-identity in /Library/Python/2.7/site-packages (from Scrapy)
Requirement already satisfied (use --upgrade to upgrade): cryptography>=0.7 in /Library/Python/2.7/site-packages (from pyOpenSSL->Scrapy)
Requirement already satisfied (use --upgrade to upgrade): zope.interface>=3.6.0 in /System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python (from Twisted>=10.0.0->Scrapy)
Requirement already satisfied (use --upgrade to upgrade): characteristic>=14.0.0 in /Library/Python/2.7/site-packages (from service-identity->Scrapy)
Requirement already satisfied (use --upgrade to upgrade): pyasn1-modules in /Library/Python/2.7/site-packages (from service-identity->Scrapy)
Requirement already satisfied (use --upgrade to upgrade): pyasn1 in /Library/Python/2.7/site-packages (from service-identity->Scrapy)
Requirement already satisfied (use --upgrade to upgrade): enum34 in /Library/Python/2.7/site-packages (from cryptography>=0.7->pyOpenSSL->Scrapy)
Requirement already satisfied (use --upgrade to upgrade): ipaddress in /Library/Python/2.7/site-packages (from cryptography>=0.7->pyOpenSSL->Scrapy)
Requirement already satisfied (use --upgrade to upgrade): setuptools>=1.0 in /Library/Python/2.7/site-packages (from cryptography>=0.7->pyOpenSSL->Scrapy)
Requirement already satisfied (use --upgrade to upgrade): idna>=2.0 in /Library/Python/2.7/site-packages (from cryptography>=0.7->pyOpenSSL->Scrapy)
Requirement already satisfied (use --upgrade to upgrade): cffi>=1.4.1 in /Library/Python/2.7/site-packages (from cryptography>=0.7->pyOpenSSL->Scrapy)
Requirement already satisfied (use --upgrade to upgrade): pycparser in /Library/Python/2.7/site-packages (from cffi>=1.4.1->cryptography>=0.7->pyOpenSSL->Scrapy)
Installing collected packages: Twisted, Scrapy
Running setup.py install for Twisted ... done
Successfully installed Scrapy-1.0.5 Twisted-15.5.0

MacBook-Pro:~ EverybodyLies$ sudo pip install Scrapy

Collecting Scrapy

Downloading Scrapy-1.0.5-py2-none-any.whl (291kB)

100% |████████████████████████████████| 294kB 257kB/s

Requirement already satisfied (use --upgrade to upgrade): cssselect>=0.9 in /Library/Python/2.7/site-packages (from Scrapy)

Requirement already satisfied (use --upgrade to upgrade): queuelib in /Library/Python/2.7/site-packages (from Scrapy)

Requirement already satisfied (use --upgrade to upgrade): pyOpenSSL in /Library/Python/2.7/site-packages (from Scrapy)

Requirement already satisfied (use --upgrade to upgrade): w3lib>=1.8.0 in /Library/Python/2.7/site-packages (from Scrapy)

Requirement already satisfied (use --upgrade to upgrade): lxml in /Library/Python/2.7/site-packages (from Scrapy)

Collecting Twisted>=10.0.0 (from Scrapy)

Downloading Twisted-15.5.0.tar.bz2 (3.1MB)

100% |████████████████████████████████| 3.1MB 105kB/s

Requirement already satisfied (use --upgrade to upgrade): six>=1.5.2 in /Library/Python/2.7/site-packages (from Scrapy)

Requirement already satisfied (use --upgrade to upgrade): service-identity in /Library/Python/2.7/site-packages (from Scrapy)

Requirement already satisfied (use --upgrade to upgrade): cryptography>=0.7 in /Library/Python/2.7/site-packages (from pyOpenSSL->Scrapy)

Requirement already satisfied (use --upgrade to upgrade): zope.interface>=3.6.0 in /System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python (from Twisted>=10.0.0->Scrapy)

Requirement already satisfied (use --upgrade to upgrade): characteristic>=14.0.0 in /Library/Python/2.7/site-packages (from service-identity->Scrapy)

Requirement already satisfied (use --upgrade to upgrade): pyasn1-modules in /Library/Python/2.7/site-packages (from service-identity->Scrapy)

Requirement already satisfied (use --upgrade to upgrade): pyasn1 in /Library/Python/2.7/site-packages (from service-identity->Scrapy)

Requirement already satisfied (use --upgrade to upgrade): enum34 in /Library/Python/2.7/site-packages (from cryptography>=0.7->pyOpenSSL->Scrapy)

Requirement already satisfied (use --upgrade to upgrade): ipaddress in /Library/Python/2.7/site-packages (from cryptography>=0.7->pyOpenSSL->Scrapy)

Requirement already satisfied (use --upgrade to upgrade): setuptools>=1.0 in /Library/Python/2.7/site-packages (from cryptography>=0.7->pyOpenSSL->Scrapy)

Requirement already satisfied (use --upgrade to upgrade): idna>=2.0 in /Library/Python/2.7/site-packages (from cryptography>=0.7->pyOpenSSL->Scrapy)

Requirement already satisfied (use --upgrade to upgrade): cffi>=1.4.1 in /Library/Python/2.7/site-packages (from cryptography>=0.7->pyOpenSSL->Scrapy)

Requirement already satisfied (use --upgrade to upgrade): pycparser in /Library/Python/2.7/site-packages (from cffi>=1.4.1->cryptography>=0.7->pyOpenSSL->Scrapy)

Installing collected packages: Twisted, Scrapy

Running setup.py install for Twisted ... done

Successfully installed Scrapy-1.0.5 Twisted-15.5.0

安装成功。

在OS X 10.11 (El Capitan)中用pip安装Scrapy遇到无法更新six包的错误

薛定谔的nil2016年2月11日 0 Comments

在OSX 10.11 (El Capitan) 中用pip安装Scrapy时遇到了这样的问题：

MacBook-Pro:~ EverybodyLies$ sudo pip install Scrapy
The directory '/Users/EverybodyLies/Library/Caches/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
The directory '/Users/EverybodyLies/Library/Caches/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
Collecting Scrapy
Downloading Scrapy-1.0.5-py2-none-any.whl (291kB)
100% |████████████████████████████████| 294kB 1.5MB/s
Collecting cssselect>=0.9 (from Scrapy)
Downloading cssselect-0.9.1.tar.gz
Collecting queuelib (from Scrapy)
Downloading queuelib-1.4.2-py2.py3-none-any.whl
Requirement already satisfied (use --upgrade to upgrade): pyOpenSSL in /System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python (from Scrapy)
Collecting w3lib>=1.8.0 (from Scrapy)
Downloading w3lib-1.13.0-py2.py3-none-any.whl
Collecting lxml (from Scrapy)
Downloading lxml-3.5.0.tar.gz (3.8MB)
100% |████████████████████████████████| 3.8MB 106kB/s
Collecting Twisted>=10.0.0 (from Scrapy)
Downloading Twisted-15.5.0.tar.bz2 (3.1MB)
100% |████████████████████████████████| 3.1MB 127kB/s
Collecting six>=1.5.2 (from Scrapy)
Downloading six-1.10.0-py2.py3-none-any.whl
Requirement already satisfied (use --upgrade to upgrade): service-identity in /Library/Python/2.7/site-packages (from Scrapy)
Requirement already satisfied (use --upgrade to upgrade): zope.interface>=3.6.0 in /System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python (from Twisted>=10.0.0->Scrapy)
Requirement already satisfied (use --upgrade to upgrade): characteristic>=14.0.0 in /Library/Python/2.7/site-packages (from service-identity->Scrapy)
Requirement already satisfied (use --upgrade to upgrade): pyasn1-modules in /Library/Python/2.7/site-packages (from service-identity->Scrapy)
Requirement already satisfied (use --upgrade to upgrade): pyasn1 in /Library/Python/2.7/site-packages (from service-identity->Scrapy)
Requirement already satisfied (use --upgrade to upgrade): setuptools in /System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python (from zope.interface>=3.6.0->Twisted>=10.0.0->Scrapy)
Installing collected packages: cssselect, queuelib, six, w3lib, lxml, Twisted, Scrapy
Running setup.py install for cssselect ... done
Found existing installation: six 1.4.1
DEPRECATION: Uninstalling a distutils installed project (six) has been deprecated and will be removed in a future version. This is due to the fact that uninstalling a distutils project will only partially uninstall the project.
Uninstalling six-1.4.1:
Exception:
Traceback (most recent call last):
File "/Library/Python/2.7/site-packages/pip/basecommand.py", line 209, in main
status = self.run(options, args)
File "/Library/Python/2.7/site-packages/pip/commands/install.py", line 317, in run
prefix=options.prefix_path,
File "/Library/Python/2.7/site-packages/pip/req/req_set.py", line 725, in install
requirement.uninstall(auto_confirm=True)
File "/Library/Python/2.7/site-packages/pip/req/req_install.py", line 752, in uninstall
paths_to_remove.remove(auto_confirm)
File "/Library/Python/2.7/site-packages/pip/req/req_uninstall.py", line 115, in remove
renames(path, new_path)
File "/Library/Python/2.7/site-packages/pip/utils/__init__.py", line 266, in renames
shutil.move(old, new)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 302, in move
copy2(src, real_dst)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 131, in copy2
copystat(src, dst)
File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 103, in copystat
os.chflags(dst, st.st_flags)
OSError: [Errno 1] Operation not permitted: '/tmp/pip-2O_yX_-uninstall/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/six-1.4.1-py2.7.egg-info'

MacBook-Pro:~ EverybodyLies$ sudo pip install Scrapy

Collecting Scrapy

Downloading Scrapy-1.0.5-py2-none-any.whl (291kB)

100% |████████████████████████████████| 294kB 1.5MB/s

Collecting cssselect>=0.9 (from Scrapy)

Downloading cssselect-0.9.1.tar.gz

Collecting queuelib (from Scrapy)

Downloading queuelib-1.4.2-py2.py3-none-any.whl

Requirement already satisfied (use --upgrade to upgrade): pyOpenSSL in /System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python (from Scrapy)

Collecting w3lib>=1.8.0 (from Scrapy)

Downloading w3lib-1.13.0-py2.py3-none-any.whl

Collecting lxml (from Scrapy)

Downloading lxml-3.5.0.tar.gz (3.8MB)

100% |████████████████████████████████| 3.8MB 106kB/s

Collecting Twisted>=10.0.0 (from Scrapy)

Downloading Twisted-15.5.0.tar.bz2 (3.1MB)

100% |████████████████████████████████| 3.1MB 127kB/s

Collecting six>=1.5.2 (from Scrapy)

Downloading six-1.10.0-py2.py3-none-any.whl

Requirement already satisfied (use --upgrade to upgrade): service-identity in /Library/Python/2.7/site-packages (from Scrapy)

Requirement already satisfied (use --upgrade to upgrade): zope.interface>=3.6.0 in /System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python (from Twisted>=10.0.0->Scrapy)

Requirement already satisfied (use --upgrade to upgrade): characteristic>=14.0.0 in /Library/Python/2.7/site-packages (from service-identity->Scrapy)

Requirement already satisfied (use --upgrade to upgrade): pyasn1-modules in /Library/Python/2.7/site-packages (from service-identity->Scrapy)

Requirement already satisfied (use --upgrade to upgrade): pyasn1 in /Library/Python/2.7/site-packages (from service-identity->Scrapy)

Requirement already satisfied (use --upgrade to upgrade): setuptools in /System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python (from zope.interface>=3.6.0->Twisted>=10.0.0->Scrapy)

Installing collected packages: cssselect, queuelib, six, w3lib, lxml, Twisted, Scrapy

Running setup.py install for cssselect ... done

Found existing installation: six 1.4.1

DEPRECATION: Uninstalling a distutils installed project (six) has been deprecated and will be removed in a future version. This is due to the fact that uninstalling a distutils project will only partially uninstall the project.

Uninstalling six-1.4.1:

Exception:

Traceback (most recent call last):

File "/Library/Python/2.7/site-packages/pip/basecommand.py", line 209, in main

status = self.run(options, args)

File "/Library/Python/2.7/site-packages/pip/commands/install.py", line 317, in run

prefix=options.prefix_path,

File "/Library/Python/2.7/site-packages/pip/req/req_set.py", line 725, in install

requirement.uninstall(auto_confirm=True)

File "/Library/Python/2.7/site-packages/pip/req/req_install.py", line 752, in uninstall

paths_to_remove.remove(auto_confirm)

File "/Library/Python/2.7/site-packages/pip/req/req_uninstall.py", line 115, in remove

renames(path, new_path)

File "/Library/Python/2.7/site-packages/pip/utils/__init__.py", line 266, in renames

shutil.move(old, new)

File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 302, in move

copy2(src, real_dst)

File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 131, in copy2

copystat(src, dst)

File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 103, in copystat

os.chflags(dst, st.st_flags)

OSError: [Errno 1] Operation not permitted: '/tmp/pip-2O_yX_-uninstall/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/six-1.4.1-py2.7.egg-info'

去网上查找解决方法，看到了这个：“OSError: [Errno 1] Operation not permitted” when installing Scrapy in OSX 10.11 (El Capitan) (System Integrity Protection)，发现问题一模一样，于是就按照回答开始尝试。

按照最高票回答的方法尝试手动更新six：

MacBook-Pro:~ EverybodyLies$ sudo -H pip install --ignore-installed six
Password:
Collecting six
Using cached six-1.10.0-py2.py3-none-any.whl
Installing collected packages: six
Successfully installed six-1.4.1

MacBook-Pro:~ EverybodyLies$ sudo -H pip install --ignore-installed six

Password:

Collecting six

Using cached six-1.10.0-py2.py3-none-any.whl

Installing collected packages: six

Successfully installed six-1.4.1

然而并没有成功更新！于是去看了：Source: github.com/pypa/pip/issues/3165

按照里面的某些讨论进行尝试：

MacBook-Pro:~ EverybodyLies$ sudo -H pip install Scrapy --upgrade --ignore-installed six

1	MacBook-Pro:~ EverybodyLies$ sudo -H pip install Scrapy --upgrade --ignore-installed six

的确没有再次报错，但是我觉得并没有解决这个问题（后来检查日志应该是更新成功了）。

另一个同学在尝试中使用easy_install升级six，解决了这个问题，我也进行了这种尝试：

MacBook-Pro:~ EverybodyLies$ sudo easy_install "six>=1.5.2"
Password:
Searching for six>=1.5.2
Best match: six 1.10.0
Adding six 1.10.0 to easy-install.pth file

Using /Library/Python/2.7/site-packages
Processing dependencies for six>=1.5.2
Finished processing dependencies for six>=1.5.2

MacBook-Pro:~ EverybodyLies$ sudo easy_install "six>=1.5.2"

Password:

Searching for six>=1.5.2

Best match: six 1.10.0

Adding six 1.10.0 to easy-install.pth file

Using /Library/Python/2.7/site-packages

Processing dependencies for six>=1.5.2

Finished processing dependencies for six>=1.5.2

非常顺利就能完成six的升级。

一些思考：

在解决这个问题的过程中我一开始觉得是10.11中SIP的问题，而且很多文章也说是SIP的问题。

但是后来另一个同学用easy_install很容易的就升级了six，我突然意识到可能是six这个包本来是用easy_install安装的，因此pip才无法卸载six。

Xcode资源文件清理：删除无用的旧设备支持文件

薛定谔的nil2016年1月24日 0 Comments

Mac硬盘只剩下20G可用空间了，做了清理也只清理出了3G可用空间，但是印象里自己并没有在电脑存太多东西啊！于是开始做手动磁盘清理，在检查用户目录下的资源库时，发现这个目录异常的大：

~/Library/Developer/Xcode/iOS\ DeviceSupport

里面似乎是各个版本的iOS支持文件，甚至还有6.1.3版本的支持文件。如果能删除旧版的支持文件，那就能给电脑腾出一大块空间啊！于是找了一下资料，看能不能删除。

根据这个回答，删除旧版支持文件是完全没有问题的，甚至可以全部删除，并且应该定期删除！

Linux下批量替换文件名中的部分字段

薛定谔的nil2016年1月16日 0 Comments

从网上下载了一批旧的影视剧资源，命名倒是挺规范，但是不和我的胃口，想要重新命名。

但是不能用简单的批量重命名，因为原文件名里包含一个集名的字段，这个字段一定是不同的。如果用批量重命名，会导致这个字段消失，然而我想保留它，于是想批量替换掉我不想要的字段。

Mac上用brew安装了rename，默认安装的是Perl 语言版本。

命令格式：rename ‘s/原字符串/新字符串/’ 文件名

字符串支持正则，要注意字符元的使用和转义。

同时，原字符串只会在一个文件名中匹配一次，例如：

[舌尖上的中国][01][高清版][HR-HDTV].mp4

执行：rename ‘s/\]\[/./’

[舌尖上的中国.01][高清版][HR-HDTV].mp4

tree命令在Mac终端中文文件名显示异常

薛定谔的nil2015年10月20日 0 Comments

想要给一个朋友发自己硬盘里电子书资源列表，于是想到了tree命令。

安装后一试，

居然是这个样子！！！

最先想到的是编码错误，于是百度『linux tree 乱码』，尝试若干种解决方法，并没有什么卵用！

无意中发现了这篇文章http://wwdd23.github.io/2015/01/09/mac-tree-chinese-display-error.html，终于解决了问题。

只需要加一个参数『-N』。

$tree -N

$tree -N

制作macOS High Sierra 10.13.6的ISO安装镜像

神奇的坑

其他操作