python爬虫中遇到“\xb5”、“xa0”等字符时报错编码错误的处理方式

写python爬虫是遇到编码错误 

报错为：

UnicodeEncodeError: 'gbk' codec can't encode character '\xa0' 

经过多方查找发现 \xa0是html网页源码中的空格

解决方法

替换掉字符 ：replace(u'\xa0', u' ')

下面是一些html中的常见符号

chr	HexCode	Numeric	HTML entity
"	\x22	"	"
&	\x26	&	&
<	\x3C	&#60;	&lt;
>	\x3E	&#62;	&gt;
空格	\xA0	&#160;	&nbsp;
¡	\xA1	&#161;	&iexcl;
¢	\xA2	&#162;	&cent;
£	\xA3	&#163;	&pound;
¤	\xA4	&#164;	&curren;
¥	\xA5	&#165;	&yen;
¦	\xA6	&#166;	&brvbar;
§	\xA7	&#167;	&sect;
¨	\xA8	&#168;	&uml;
©	\xA9	&#169;	&copy;
ª	\xAA	&#170;	&ordf;
«	\xAB	&#171;	&laquo;
¬	\xAC	&#172;	&not;
	\xAD	&#173;	&shy;
®	\xAE	&#174;	&reg;
¯	\xAF	&#175;	&macr;
°	\xB0	&#176;	&deg;
±	\xB1	&#177;	&plusmn;
²	\xB2	&#178;	&sup2;
³	\xB3	&#179;	&sup3;
´	\xB4	&#180;	&acute;
µ	\xB5	&#181;	&micro;
¶	\xB6	&#182;	&para;
·	\xB7	&#183;	&middot;
¸	\xB8	&#184;	&cedil;
¹	\xB9	&#185;	&sup1;
º	\xBA	&#186;	&ordm;
»	\xBB	&#187;	&raquo;
¼	\xBC	&#188;	&frac14;
½	\xBD	&#189;	&frac12;
¾	\xBE	&#190;	&frac34;
¿	\xBF	&#191;	&iquest;
×	\xD7	&#215;	&times;
÷	\xF7	&#247;	&divide;
ƒ	\u0192	&#402;	&fnof;
ˆ	\u02C6	&#710;	&circ;
˜	\u02DC	&#732;	&tilde;
	\u2002	&#8194;	&ensp;
	\u2003	&#8195;	&emsp;
	\u2009	&#8201;	&thinsp;
	\u200C	&#8204;	&zwnj;
	\u200D	&#8205;	&zwj;
	\u200E	&#8206;	&lrm;
	\u200F	&#8207;	&rlm;
–	\u2013	&#8211;	&ndash;
—	\u2014	&#8212;	&mdash;
‘	\u2018	&#8216;	&lsquo;
’	\u2019	&#8217;	&rsquo;
‚	\u201A	&#8218;	&sbquo;
“	\u201C	&#8220;	&ldquo;
”	\u201D	&#8221;	&rdquo;
„	\u201E	&#8222;	&bdquo;
†	\u2020	&#8224;	&dagger;
‡	\u2021	&#8225;	&Dagger;
•	\u2022	&#8226;	&bull;
…	\u2026	&#8230;	&hellip;
‰	\u2030	&#8240;	&permil;
′	\u2032	&#8242;	&prime;
″	\u2033	&#8243;	&Prime;
‹	\u2039	&#8249;	&lsaquo;
›	\u203A	&#8250;	&rsaquo;
‾	\u203E	&#8254;	&oline;
⁄	\u2044	&#8260;	&frasl;
€	\u20AC	&#8364;	&euro;
ℑ	\u2111	&#8465;	&image;
?	\u2113	&#8467;
№	\u2116	&#8470;
℘	\u2118	&#8472;	&weierp;
ℜ	\u211C	&#8476;	&real;
™	\u2122	&#8482;	&trade;
ℵ	\u2135	&#8501;	&alefsym;
←	\u2190	&#8592;	&larr;
↑	\u2191	&#8593;	&uarr;
→	\u2192	&#8594;	&rarr;
↓	\u2193	&#8595;	&darr;
↔	\u2194	&#8596;	&harr;
↵	\u21B5	&#8629;	&crarr;
⇐	\u21D0	&#8656;	&lArr;
⇑	\u21D1	&#8657;	&uArr;
⇒	\u21D2	&#8658;	&rArr;
⇓	\u21D3	&#8659;	&dArr;
⇔	\u21D4	&#8660;	&hArr;
∀	\u2200	&#8704;	&forall;
∂	\u2202	&#8706;	&part;
∃	\u2203	&#8707;	&exist;
∅	\u2205	&#8709;	&empty;
∇	\u2207	&#8711;	&nabla;
∈	\u2208	&#8712;	&isin;
∉	\u2209	&#8713;	&notin;
∋	\u220B	&#8715;	&ni;
∏	\u220F	&#8719;	&prod;
∑	\u2211	&#8721;	&sum;
−	\u2212	&#8722;	&minus;
∗	\u2217	&#8727;	&lowast;
√	\u221A	&#8730;	&radic;
∝	\u221D	&#8733;	&prop;
∞	\u221E	&#8734;	&infin;
∠	\u2220	&#8736;	&ang;
∧	\u2227	&#8743;	&and;
∨	\u2228	&#8744;	&or;
∩	\u2229	&#8745;	&cap;
∪	\u222A	&#8746;	&cup;
∫	\u222B	&#8747;	&int;
∴	\u2234	&#8756;	&there4;
∼	\u223C	&#8764;	&sim;
≅	\u2245	&#8773;	&cong;
≈	\u2248	&#8776;	&asymp;
≠	\u2260	&#8800;	&ne;
≡	\u2261	&#8801;	&equiv;
≤	\u2264	&#8804;	&le;
≥	\u2265	&#8805;	&ge;
⊂	\u2282	&#8834;	&sub;
⊃	\u2283	&#8835;	&sup;
⊄	\u2284	&#8836;	&nsub;
⊆	\u2286	&#8838;	&sube;
⊇	\u2287	&#8839;	&supe;
⊕	\u2295	&#8853;	&oplus;
⊗	\u2297	&#8855;	&otimes;
⊥	\u22A5	&#8869;	&perp;
⋅	\u22C5	&#8901;	&sdot;
⌈	\u2308	&#8968;	&lceil;
⌉	\u2309	&#8969;	&rceil;
⌊	\u230A	&#8970;	&lfloor;
⌋	\u230B	&#8971;	&rfloor;
⟨	\u2329	&#9001;	&lang;
⟩	\u232A	&#9002;	&rang;
◊	\u25CA	&#9674;	&loz;
♠	\u2660	&#9824;	&spades;
♣	\u2663	&#9827;	&clubs;
♥	\u2665	&#9829;	&hearts;
♦	\u2666	&#9830;	&diams;