该博客内容参考http://www.cnblogs.com/wupeiqi/articles/4943406.html
内置函数 一
详细见python文档，猛击这里
文件操作
操作文件时，一般需要经历如下步骤：
- 打开文件
- 操作文件
一、打开文件
|
1
|
文件句柄 = file('文件路径', '模式') |
注：python中打开文件有两种方式，即：open(...) 和 file(...) ，本质上前者在内部会调用后者来进行文件操作，推荐使用 open。
打开文件时，需要指定文件路径和以何等方式打开文件，打开后，即可获取该文件句柄，日后通过此文件句柄对该文件操作。
打开文件的模式有：
- r，只读模式（默认）。
- w，只写模式。【不可读；不存在则创建；存在则删除内容；】
- a，追加模式。【可读； 不存在则创建；存在则只追加内容；】
"+" 表示可以同时读写某个文件
- r+，可读写文件。【可读；可写；可追加】
- w+，写读
- a+，同a
"U"表示在读取时，可以将 \r \n \r\n自动转换成 \n （与 r 或 r+ 模式同使用）
- rU
- r+U
"b"表示处理二进制文件（如：FTP发送上传ISO镜像文件，linux可忽略，windows处理二进制文件时需标注）
- rb
- wb
- ab
二、操作操作
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
|
class file(object): def close(self): # real signature unknown; restored from __doc__ 关闭文件 """ close() -> None or (perhaps) an integer. Close the file. Sets data attribute .closed to True. A closed file cannot be used for further I/O operations. close() may be called more than once without error. Some kinds of file objects (for example, opened by popen()) may return an exit status upon closing. """ def fileno(self): # real signature unknown; restored from __doc__ 文件描述符 """ fileno() -> integer "file descriptor". This is needed for lower-level file interfaces, such os.read(). """ return 0 def flush(self): # real signature unknown; restored from __doc__ 刷新文件内部缓冲区 """ flush() -> None. Flush the internal I/O buffer. """ pass def isatty(self): # real signature unknown; restored from __doc__ 判断文件是否是同意tty设备 """ isatty() -> true or false. True if the file is connected to a tty device. """ return False def next(self): # real signature unknown; restored from __doc__ 获取下一行数据，不存在，则报错 """ x.next() -> the next value, or raise StopIteration """ pass def read(self, size=None): # real signature unknown; restored from __doc__ 读取指定字节数据 """ read([size]) -> read at most size bytes, returned as a string. If the size argument is negative or omitted, read until EOF is reached. Notice that when in non-blocking mode, less data than what was requested may be returned, even if no size parameter was given. """ pass def readinto(self): # real signature unknown; restored from __doc__ 读取到缓冲区，不要用，将被遗弃 """ readinto() -> Undocumented. Don't use this; it may go away. """ pass def readline(self, size=None): # real signature unknown; restored from __doc__ 仅读取一行数据 """ readline([size]) -> next line from the file, as a string. Retain newline. A non-negative size argument limits the maximum number of bytes to return (an incomplete line may be returned then). Return an empty string at EOF. """ pass def readlines(self, size=None): # real signature unknown; restored from __doc__ 读取所有数据，并根据换行保存值列表 """ readlines([size]) -> list of strings, each a line from the file. Call readline() repeatedly and return a list of the lines so read. The optional size argument, if given, is an approximate bound on the total number of bytes in the lines returned. """ return [] def seek(self, offset, whence=None): # real signature unknown; restored from __doc__ 指定文件中指针位置 """ seek(offset[, whence]) -> None. Move to new file position. Argument offset is a byte count. Optional argument whence defaults to 0 (offset from start of file, offset should be >= 0); other values are 1 (move relative to current position, positive or negative), and 2 (move relative to end of file, usually negative, although many platforms allow seeking beyond the end of a file). If the file is opened in text mode, only offsets returned by tell() are legal. Use of other offsets causes undefined behavior. Note that not all file objects are seekable. """ pass def tell(self): # real signature unknown; restored from __doc__ 获取当前指针位置 """ tell() -> current file position, an integer (may be a long integer). """ pass def truncate(self, size=None): # real signature unknown; restored from __doc__ 截断数据，仅保留指定之前数据 """ truncate([size]) -> None. Truncate the file to at most size bytes. Size defaults to the current file position, as returned by tell(). """ pass def write(self, p_str): # real signature unknown; restored from __doc__ 写内容 """ write(str) -> None. Write string str to file. Note that due to buffering, flush() or close() may be needed before the file on disk reflects the data written. """ pass def writelines(self, sequence_of_strings): # real signature unknown; restored from __doc__ 将一个字符串列表写入文件 """ writelines(sequence_of_strings) -> None. Write the strings to the file. Note that newlines are not added. The sequence can be any iterable object producing strings. This is equivalent to calling write() for each string. """ pass def xreadlines(self): # real signature unknown; restored from __doc__ 可用于逐行读取文件，非全部 """ xreadlines() -> returns self. For backward compatibility. File objects now include the performance optimizations previously implemented in the xreadlines module. """ pass |
三、with
为了避免打开文件后忘记关闭，可以通过管理上下文，即：
|
1
2
3
|
with open('log','r') as f: ... |
如此方式，当with代码块执行完毕时，内部会自动关闭并释放文件资源。
在Python 2.7 后，with又支持同时对多个文件的上下文进行管理，即：
|
1
2
|
with open('log1') as obj1, open('log2') as obj2: pass |
四、那么问题来了...
1、如何在线上环境优雅的修改配置文件?
- rU
- r+U
"b"表示处理二进制文件（如：FTP发送上传ISO镜像文件，linux可忽略，windows处理二进制文件时需标注）
- rb
- wb
- ab
二、操作操作
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
|
class file(object): def close(self): # real signature unknown; restored from __doc__ 关闭文件 """ close() -> None or (perhaps) an integer. Close the file. Sets data attribute .closed to True. A closed file cannot be used for further I/O operations. close() may be called more than once without error. Some kinds of file objects (for example, opened by popen()) may return an exit status upon closing. """ def fileno(self): # real signature unknown; restored from __doc__ 文件描述符 """ fileno() -> integer "file descriptor". This is needed for lower-level file interfaces, such os.read(). """ return 0 def flush(self): # real signature unknown; restored from __doc__ 刷新文件内部缓冲区 """ flush() -> None. Flush the internal I/O buffer. """ pass def isatty(self): # real signature unknown; restored from __doc__ 判断文件是否是同意tty设备 """ isatty() -> true or false. True if the file is connected to a tty device. """ return False def next(self): # real signature unknown; restored from __doc__ 获取下一行数据，不存在，则报错 """ x.next() -> the next value, or raise StopIteration """ pass def read(self, size=None): # real signature unknown; restored from __doc__ 读取指定字节数据 """ read([size]) -> read at most size bytes, returned as a string. If the size argument is negative or omitted, read until EOF is reached. Notice that when in non-blocking mode, less data than what was requested may be returned, even if no size parameter was given. """ pass def readinto(self): # real signature unknown; restored from __doc__ 读取到缓冲区，不要用，将被遗弃 """ readinto() -> Undocumented. Don't use this; it may go away. """ pass def readline(self, size=None): # real signature unknown; restored from __doc__ 仅读取一行数据 """ readline([size]) -> next line from the file, as a string. Retain newline. A non-negative size argument limits the maximum number of bytes to return (an incomplete line may be returned then). Return an empty string at EOF. """ pass def readlines(self, size=None): # real signature unknown; restored from __doc__ 读取所有数据，并根据换行保存值列表 """ readlines([size]) -> list of strings, each a line from the file. Call readline() repeatedly and return a list of the lines so read. The optional size argument, if given, is an approximate bound on the total number of bytes in the lines returned. """ return [] def seek(self, offset, whence=None): # real signature unknown; restored from __doc__ 指定文件中指针位置 """ seek(offset[, whence]) -> None. Move to new file position. Argument offset is a byte count. Optional argument whence defaults to 0 (offset from start of file, offset should be >= 0); other values are 1 (move relative to current position, positive or negative), and 2 (move relative to end of file, usually negative, although many platforms allow seeking beyond the end of a file). If the file is opened in text mode, only offsets returned by tell() are legal. Use of other offsets causes undefined behavior. Note that not all file objects are seekable. """ pass def tell(self): # real signature unknown; restored from __doc__ 获取当前指针位置 """ tell() -> current file position, an integer (may be a long integer). """ pass def truncate(self, size=None): # real signature unknown; restored from __doc__ 截断数据，仅保留指定之前数据 """ truncate([size]) -> None. Truncate the file to at most size bytes. Size defaults to the current file position, as returned by tell(). """ pass def write(self, p_str): # real signature unknown; restored from __doc__ 写内容 """ write(str) -> None. Write string str to file. Note that due to buffering, flush() or close() may be needed before the file on disk reflects the data written. """ pass def writelines(self, sequence_of_strings): # real signature unknown; restored from __doc__ 将一个字符串列表写入文件 """ writelines(sequence_of_strings) -> None. Write the strings to the file. Note that newlines are not added. The sequence can be any iterable object producing strings. This is equivalent to calling write() for each string. """ pass def xreadlines(self): # real signature unknown; restored from __doc__ 可用于逐行读取文件，非全部 """ xreadlines() -> returns self. For backward compatibility. File objects now include the performance optimizations previously implemented in the xreadlines module. """ pass |
三、with
为了避免打开文件后忘记关闭，可以通过管理上下文，即：
|
1
2
3
|
with open('log','r') as f: ... |
如此方式，当with代码块执行完毕时，内部会自动关闭并释放文件资源。
在Python 2.7 后，with又支持同时对多个文件的上下文进行管理，即：
|
1
2
|
with open('log1') as obj1, open('log2') as obj2: pass |
四、那么问题来了...
1、如何在线上环境优雅的修改配置文件?
1 global 2 log 127.0.0.1 local2 3 daemon 4 maxconn 256 5 log 127.0.0.1 local2 info 6 defaults 7 log global 8 mode http 9 timeout connect 5000ms 10 timeout client 50000ms 11 timeout server 50000ms 12 option dontlognull 13 14 listen stats :8888 15 stats enable 16 stats uri /admin 17 stats auth admin:1234 18 19 frontend oldboy.org 20 bind 0.0.0.0:80 21 option httplog 22 option httpclose 23 option forwardfor 24 log global 25 acl www hdr_reg(host) -i www.oldboy.org 26 use_backend www.oldboy.org if www 27 28 backend www.oldboy.org 29 server 100.1.7.9 100.1.7.9 weight 20 maxconn 3000
需求
1 #!/usr/bin/env python 2 # -*- coding:utf-8 -*- 3 import json 4 def fetch(keys): #查询 5 user_list=[] 6 flag=False #标志位 7 with open ('log.txt') as obj: #打开文件进行管理 8 for line in obj: # 对文件句柄obj进行遍历 9 line_str=line.strip() # 得到去空格后的字符串 10 if line_str=="backend %s" %keys: #输入的字符串==backend 'key' 则把标志位置为True 然后重新循环 11 flag=True 12 continue 13 if line_str.startswith('backend') and flag: #遍历到首字符串为backend 并且 flag为True的情况下则退出循环，至此得到查询的内容。 加flag是为了误跳出循环。 14 break 15 if flag and line_str: #标志位为True且line_str为非空格则把内容加入到user_list列表 作为自定义函数的返回值。 16 user_list.append(line_str) 17 return user_list 18 19 #keys=raw_input("please input your fetch:") 20 #print 'your fetch %s' %keys 21 #print fetch(keys) 22 def add1 (user_dic): 23 backend_user=user_dic['backend'] #把传入的字典进行分割把把相应的key传给变量，后续使用。 24 backend_user1='backend %s' %backend_user 25 #server 100.1.7.9 100.1.7.10 weight 20 maxconn 3000 26 record_user='\n%s server:%s weight:%d maxconn:%d\n' %(7*(" "),user_dic['record']['server'],user_dic['record']['weight'],user_dic['record']['maxconn']) 27 result_fetch=fetch(backend_user) #把上个函数查询的结果返回给变量，给后续使用，若为空列表则bool值为False 28 if result_fetch: # 如果返回值为空则把log全部写入到log1文件且在最后追加新的字符串，如果返回值非空的话， 29 flag=False # 先检查新加的字符串是否存在，存在则输出“输入的字符串已存在”不存在则把新加的字符串 30 s=False # 追加到上个函数的返回值列表，在把新增的字符串写入文件的时候需要新增一个标志位 31 if record_user.strip() in result_fetch:#s 如果 s为false 表示没有写入 if not s 为True执行写入动作。 32 print '你输入的字符串已存在！' 33 else: 34 result_fetch.append(record_user) 35 print result_fetch 36 with open('log.txt','r') as obj1,open('log1.txt','w') as obj2: 37 for line in obj1: 38 if line.strip() ==backend_user1: 39 flag=True 40 obj2.write(line) 41 continue 42 if line.startswith('backend') and flag: 43 flag=False 44 if flag: 45 if not s: 46 for lines in result_fetch: 47 obj2.write('\n%s' %(8*" ")) 48 obj2.write(lines) 49 s=True 50 else: 51 obj2.write(line) 52 else: 53 with open('log.txt') as obj1,open('log1.txt','w') as obj2: 54 for line in obj1: 55 obj2.write(line) 56 obj2.write('\n') 57 obj2.write(backend_user+'\n') 58 obj2.write(record_user) 59 60 def del1(backend): 61 flag=True 62 del_user=fetch(backend) 63 with open('log.txt') as obj1,open('log1.txt','w') as obj2: 64 for line in obj1: 65 if line.strip()=='backend %s' %backend: 66 flag=False 67 continue 68 if line.startswith('backend') and not flag: 69 flag=True 70 # obj2.write(line) 71 if flag: 72 obj2.write(line) 73 74 s= '{"backend": "www.oldboy.org", "record":{"server": "10.1.7.91","weight": 20,"maxconn": 30}}' 75 dic_user=json.loads(s) 76 #print dic_user 77 add1(dic_user) 78 #del1('www.oldboy.org') 79 #keys=raw_input("please input your fetch:") 80 #print 'your fetch %s' %keys 81 #print fetch(keys)
二、 函数的定义和使用
|
1
2
3
4
5
|
def 函数名(参数): ... 函数体 ... |
函数的定义主要有如下要点：
- def：表示函数的关键字
- 函数名：函数的名称，日后根据函数名调用函数
- 函数体：函数中进行一系列的逻辑计算，如：发送邮件、计算出 [11,22,38,888,2]中的最大数等...
- 参数：为函数体提供数据
- 返回值：当函数执行完毕后，可以给调用者返回数据。
以上要点中，比较重要有参数和返回值：
1、返回值
函数是一个功能块，该功能到底执行成功与否，需要通过返回值来告知调用者。
def 发送短信():
发送短信的代码...
if 发送成功:
return True
else:
return False
while True:
# 每次执行发送短信函数，都会将返回值自动赋值给result
# 之后，可以根据result来写日志，或重发等操作
result = 发送短信()
if result == False:
记录日志，短信发送失败...
2、参数
为什么要有参数？
1 def CPU报警邮件() 2 #发送邮件提醒 3 连接邮箱服务器 4 发送邮件 5 关闭连接 6 7 def 硬盘报警邮件() 8 #发送邮件提醒 9 连接邮箱服务器 10 发送邮件 11 关闭连接 12 13 def 内存报警邮件() 14 #发送邮件提醒 15 连接邮箱服务器 16 发送邮件 17 关闭连接 18 19 while True： 20 21 if cpu利用率 > 90%: 22 CPU报警邮件（） 23 24 if 硬盘使用空间 > 90%: 25 硬盘报警邮件（） 26 27 if 内存占用 > 80%: 28 内存报警邮件（）
1 def 发送邮件(邮件内容) 2 3 #发送邮件提醒 4 连接邮箱服务器 5 发送邮件 6 关闭连接 7 8 9 while True： 10 11 if cpu利用率 > 90%: 12 发送邮件("CPU报警了。") 13 14 if 硬盘使用空间 > 90%: 15 发送邮件("硬盘报警了。") 16 17 if 内存占用 > 80%: 18 发送邮件("内存报警了。")
函数的有三中不同的参数：
- 普通参数
- 默认参数
- 动态参数
1 # ######### 定义函数 ######### 2 3 # name 叫做函数func的形式参数，简称：形参 4 def func(name): 5 print name 6 7 # ######### 执行函数 ######### 8 # 'wupeiqi' 叫做函数func的实际参数，简称：实参 9 func('wupeiqi')
1 def func(name, age = 18): 2 3 print "%s:%s" %(name,age) 4 5 # 指定参数 6 func('wupeiqi', 19) 7 # 使用默认参数 8 func('alex') 9 10 注：默认参数需要放在参数列表最后
1 def func(*args): 2 3 print args 4 5 6 # 执行方式一 7 func(11,33,4,4454,5) 8 9 # 执行方式二 10 li = [11,2,2,3,3,4,54] 11 func(*li)
def func(**kwargs): print args # 执行方式一 func(name＝'wupeiqi',age=18) # 执行方式二 li = {'name':'wupeiqi', age:18, 'gender':'male'} func(**li)
1 def func(*args, **kwargs): 2 3 print args 4 print kwargs
扩展：发送邮件实例
1 import smtplib 2 from email.mime.text import MIMEText 3 from email.utils import formataddr 4 5 6 msg = MIMEText('邮件内容', 'plain', 'utf-8') 7 msg['From'] = formataddr(["武沛齐",'wptawy@126.com']) 8 msg['To'] = formataddr(["走人",'424662508@qq.com']) 9 msg['Subject'] = "主题" 10 11 server = smtplib.SMTP("smtp.126.com", 25) 12 server.login("wptawy@126.com", "邮箱密码") 13 server.sendmail('wptawy@126.com', ['424662508@qq.com',], msg.as_string()) 14 server.quit()
lambda表达式
学习条件运算时，对于简单的 if else 语句，可以使用三元运算来表示，即：
# 普通条件语句
if 1 == 1:
name = 'wupeiqi'
else:
name = 'alex'
# 三元运算
name = 'wupeiqi' if 1 == 1 else 'alex'
对于简单的函数，也存在一种简便的表示方式，即：lambda表达式
# ###################### 普通函数 ######################
# 定义函数（普通方式）
def func(arg):
return arg + 1
# 执行函数
result = func(123)
# ###################### lambda ######################
# 定义函数（lambda表达式）
my_lambda = lambda arg : arg + 1
# 执行函数
result = my_lambda(123)
lambda存在意义就是对简单函数的简洁表示
内置函数 二
一、map
遍历序列，对序列中每个元素进行操作，最终获取新的序列。
1 li = [11, 22, 33] 2 3 new_list = map(lambda a: a + 100, li)
1 li = [11, 22, 33] 2 sl = [1, 2, 3] 3 new_list = map(lambda a, b: a + b, li, sl)
二、filter
对于序列中的元素进行筛选，最终获取符合条件的序列
1 li = [11, 22, 33] 2 3 new_list = filter(lambda arg: arg > 22, li) 4 5 #filter第一个参数为空，将获取原来序列
三、reduce
对于序列内所有元素进行累计操作
1 li = [11, 22, 33] 2 3 result = reduce(lambda arg1, arg2: arg1 + arg2, li) 4 5 # reduce的第一个参数，函数必须要有两个参数 6 # reduce的第二个参数，要循环的序列 7 # reduce的第三个参数，初始值
装饰器
装饰器是函数，只不过该函数可以具有特殊的含义，装饰器用来装饰函数或类，使用装饰器可以在函数执行前和执行后添加相应操作。
def wrapper(func):
def result():
print 'before'
func()
print 'after'
return result
@wrapper
def foo():
print 'foo'
1 import functools 2 3 4 def wrapper(func): 5 @functools.wraps(func) 6 def wrapper(): 7 print 'before' 8 func() 9 print 'after' 10 return wrapper 11 12 @wrapper 13 def foo(): 14 print 'foo'
1 #!/usr/bin/env python 2 #coding:utf-8 3 4 def Before(request,kargs): 5 print 'before' 6 7 def After(request,kargs): 8 print 'after' 9 10 11 def Filter(before_func,after_func): 12 def outer(main_func): 13 def wrapper(request,kargs): 14 15 before_result = before_func(request,kargs) 16 if(before_result != None): 17 return before_result; 18 19 main_result = main_func(request,kargs) 20 if(main_result != None): 21 return main_result; 22 23 after_result = after_func(request,kargs) 24 if(after_result != None): 25 return after_result; 26 27 return wrapper 28 return outer 29 30 @Filter(Before, After) 31 def Index(request,kargs): 32 print 'index' 33 34 35 if __name__ == '__main__': 36 Index(1,2)
冒泡算法
需求：请按照从小到大对列表 [13, 22, 6, 99, 11] 进行排序
思路：相邻两个值进行比较，将较大的值放在右侧，依次比较！
1 li = [13, 22, 6, 99, 11] 2 3 for m in range(4): # 等价于 #for m in range(len(li)-1): 4 if li[m]> li[m+1]: 5 temp = li[m+1] 6 li[m+1] = li[m] 7 li[m] = temp
1 li = [13, 22, 6, 99, 11] 2 3 for m in range(4): # 等价于 #for m in range(len(li)-1): 4 if li[m]> li[m+1]: 5 temp = li[m+1] 6 li[m+1] = li[m] 7 li[m] = temp 8 9 for m in range(3): # 等价于 #for m in range(len(li)-2): 10 if li[m]> li[m+1]: 11 temp = li[m+1] 12 li[m+1] = li[m] 13 li[m] = temp 14 15 for m in range(2): # 等价于 #for m in range(len(li)-3): 16 if li[m]> li[m+1]: 17 temp = li[m+1] 18 li[m+1] = li[m] 19 li[m] = temp 20 21 for m in range(1): # 等价于 #for m in range(len(li)-4): 22 if li[m]> li[m+1]: 23 temp = li[m+1] 24 li[m+1] = li[m] 25 li[m] = temp 26 print li
1 li = [13, 22, 6, 99, 11] 2 3 for i in range(1,5): 4 for m in range(len(li)-i): 5 if li[m] > li[m+1]: 6 temp = li[m+1] 7 li[m+1] = li[m] 8 li[m] = temp
递归
利用函数编写如下数列：
斐波那契数列指的是这样一个数列 0, 1, 1, 2, 3, 5, 8, 13, 21, 34, 55, 89, 144, 233，377，610，987，1597，2584，4181，6765，10946，17711，28657，46368
1 def func(arg1,arg2): 2 if arg1 == 0: 3 print arg1, arg2 4 arg3 = arg1 + arg2 5 print arg3 6 func(arg2, arg3) 7 8 func(0,1)
浙公网安备 33010602011771号