蠎加载 105

原文: Import Python Weekly Newsletter - Issue No 105 欢迎, 来 PyChina/weekly 共同翻译/增订/推荐 周刊 蠎消息 ;-) 该读 ~ 文章, Blog, 教程… 现代字典 ~ Raymond Hettinger : Python core-python, dict Python’s dictionaries are stunningly good. Over the years, many great ideas have combined together to produce the modern implementation in Python 3.6. This fun talk is given by Raymond Hettinger, the Python core developer responsible for the set implementation and who designed the compact-and-ordered dict implemented in CPython for Python 3.6 and in PyPy for Python 2.7. (是也乎: 事实证明一个贴心的数据类型可以增加很多语言的依赖, 但是,另外一个现实也证明了只有一种数据类型的开发语言一样可以很好的使用, 所以? 存乎一心了. ) 通过 SSH 远程运行 Python 3 ssh, click I ran into this situation today where I wanted to issue a few commands over ssh to a remote host as part of a Click command I’m building to do some ops automation here at REVSYS. It’s probably not perfect in terms of error handling, but it sure is simple!. (是也乎: 嗯哼,就是 Fabric3 的软广呗. ) 用 Python 介绍数据科学 - Univeristy of Michigan data science, mooc The course will also introduce data manipulation and cleaning techniques using the popular python pandas data science library and introduce the abstraction of the DataFrame as the central data structure for data analysis. The course will end with a statistics primer, showing how various statistical measures can be applied to pandas DataFrames. By the end of the course, students will be able to take tabular data, clean it, manipulate it, and run basic inferential statistical analyses. (是也乎: 就是 panda 呗… ) 用 Python 进行数据整理 In this post, I will summarize some tidying examples Wickham uses in his paper and I will demonstrate how to do so using the Python pandas library. (是也乎: 依然是 Panda 呢… ) 用 Python 查询和展示天气数据 data science Considering rich Python Ecosystem of tools, libraries, and frameworks for data crunching, I’d like to share a few examples how to plug Datahub API as a data source to your Python-based workflow. I’ll start with a simple example: how to turn Datahub API JSON output into Numpy arrays using Pandas framework. (是也乎: 针对 Datahub API 输出的 JSON ) 2017 放弃 Python 2 python3 Python 3.6.0 came out day before yesterday, and it was like a Christmas present for many of us. But in the midst of all the celebration, many of you were still asking if it is safe to drop Python 2 and move over to Python 3. There still seems to be a fear of missing out on useful third party libraries that lack Python 3 support. So in this post, I will try to settle this issue once and for all by presenting the relevant data. After you have seen all the data, you will be able to come to your own conclusion (I have already expressed my conclusion in the title). (是也乎: 目测嗯哼的… ) 从 Python 到 Numpy numpy There are already a fair number of books about Numpy (see Bibliography) and a legitimate question is to wonder if another book is really necessary. As you may have guessed by reading these lines, my personal answer is yes, mostly because I think there is room for a different approach concentrating on the migration from Python to Numpy through vectorization. (是也乎: 是一部完备的小书…CC 协议,还没有翻译为中文…. rougier/from-python-to-numpy: An open-access book on numpy vectorization techniques, Nicolas P. Rougier, 2017 rST 格式 ) 加速 Python 运行: 案例研究 performance 支持 PyKids 服务 community pykids is a voluntary effort to bring Python to elementary school (5th & 6th grades). At present I run AWS servers to support my venture. These servers are available for anyone to use. I run a monthly bill of about 20 USD to run this server. The money that you donate will go into support keeping these servers online. 为小白的 Python IDE IDE (是也乎: 乱说! 初学更加不应该用 IDE 了… ) 检查 Python 包依赖 dependency (是也乎: 可怕的 Dependencies of django ) 为毛 Python 不是俺的最爱 opinion (是也乎: Python 的目标从来不是最爱哪… ) 好物 ~ 包/模块/库/片段… ...

2016-12-30 · 3 min · 1361 words · ZoomQuiet

蠎加载 104

原文: Import Python Weekly Newsletter - Issue No 104 欢迎, 来 PyChina/weekly 共同翻译/增订/推荐 周刊 蠎消息 ;-) 该读 ~ 文章, Blog, 教程… 房价的可负担性 - 用 Apache Spark apache spark Back in September last year, the Guardian published a fantastic visualisation looking at house price affordability in the United Kingdom. The raw data is easily available from data.gov.uk, and they provide monthly, annual and the complete history allowing you to work with a reasonably sized set before running on the complete data set. Recreating the Guardian’s data process within Apache Spark felt like a great way to get an introduction into the platform. (是也乎: 卫报编辑的折腾…这年头什么行业都不易哪 ) Sanic 入门: 基于异步/uvloop 的 web 框架仅 Python 3.5+ 支持 python3, sanic, webserver uvloop has been making waves in the Python world lately as a blazingly fast drop-in for asyncio’s default event loop. Sanic is a Flask-like, uvloop-based web framework that’s written to go fast. Sanic is made for Python 3.5 . The framework allows you to take advantage of async/await syntax for defining asynchronous functions. With this, you can write async applications in Python similar to how you would write them in Node.js. (是也乎: 目测退化为 py2 兼容的,才是成功的 ) 命名实体分类 machine learning, NLP This blog post describes three prototype solutions for the task of Named Entity Classification in the context of Booking.com. The aim is to present different approaches to the classification task, analyse their implementation and compare them in a small scale prototype use case. Sample code in Python is also provided in the following sections for each model described. pdb 到 bug humor If you have watched / heard the famous dialog from the movie taken, you will be able to understand this funny meme. 如何图形化 Python 调试器 debugging Zero-to-Debugging in 15 mins. Complementing Python With Rust rust-lang (是也乎: 又来… rust 语言发展求突破, py 这么帮不是个办法 ) 如何用 Python 重采样并插入时宜序列数据 pandas In this tutorial, you will discover how to use Pandas in Python to both increase and decrease the sampling frequency of time series data. Pythonic 代码复审 (Red Hat Security Blog) code quality Most of us programmers go through technical interviews every once in a while. At other times, many of us sit on the opposite side of the table running these interviews. Stakes are high, emotions run strong, intellectual pressure builds up. I have found that an unfortunate code review may turn into something similar to a harsh job interview. (是也乎: 其实庄表伟在 gitchat 中的系列嗯哼非常实用的了. ) Django Weekly Issue 18 djangoweekly This weeks roundup insightful articles, videos on everything Django. (是也乎: 以后 Django 相关的嗯哼,可以到专用周刊中挖掘了… 顺便先作一下 The State of the Developer Nation Survey 2017 有中文版本的 ) 介绍 Maya: 人性的数据时间 - By Kenneth Reitz open source project Datetimes are a headache to deal with in Python, especially when dealing with timezones, especially when dealing with different machines with different locales. Maya exists to do all the hard work for you, so you can focus on what you’re trying to do — import or export simple datetime data in known human and machine-readable formats. (是也乎: 处理海量数据时,时间对准越来越头痛了… ☀ Say Thank You ) 和 Python 函式编程相关的精选列表 open source project (是也乎: 竟然有这种萌物! ) 用 TensorFlow 进行交通标志识别 machine learning, tensorflow In this part, I’ll talk about image classification and I’ll keep the model as simple as possible. In later parts, I’ll cover convolutional networks, data augmentation, and object detection. Python 3 in one image infpgraph (是也乎: ) 谁可解释 David Beazley 的 tweet ? discussion I am glad someone on reddit asked this. I can’t get some of David’s tweets. It’s from his book I learned Python. If you are on twitter follow him. (是也乎: 迷之代码的嗯哼… def spam(): X: auto @ property.template X(*T, …) = object class Y(X): pass return Y() 如果 Py3 越来越象C++ 那基本上是嗯哼的 ) 好物 ~ 包/模块/库/片段… ...

2016-12-23 · 3 min · 1308 words · ZoomQuiet

蠎加载 103

原文: Import Python Weekly Newsletter - Issue No 103 欢迎, 来 PyChina/weekly 共同翻译/增订/推荐 周刊 蠎消息 ;-) 该读 ~ 文章, Blog, 教程… PyCon Canada 视频 video, conference, pycon-canada PyCon Canada’s Youtube channel now has most of the event’s videos. (是也乎: 当然的 油管儿的…) 通过 Python 函式进行追踪 debugging python-execution-trace allows you to choose what function you are interested in and it records its execution(s), together with the local state. You can then step through any execution, both forwards and backwards. All you need to do is pip install the library, decorate the target function and run your code as you normally do. (是也乎: Py3 的库, python-execution-trace 妄想恢复当年 C++ 的单步追踪的体验.. ) 课程:用 Python 获取 web 数据 - By University of Michigan scraping This course will show how one can treat the Internet as a source of data. We will scrape, parse, and read web data as well as access data using web APIs. 在 Python 中如何规范化/标准化时间序列数据 time-series Some machine learning algorithms will achieve better performance if your time series data has a consistent scale or distribution. Two techniques that you can use to consistently rescale your time series data are normalization and standardization. In this tutorial, you will discover how you can apply normalization and standardization rescaling to your time series data in Python. (是也乎: 嗯哼?! 居然要动用机械学习!? ) 一次奇异的 Python 内存泄漏追踪 - By Benoit Bernard debugging “I thought that memory leaks were impossible in Python?”, I said to myself, staring incredulously at my screen. It was 8:00 PM. The memory use of my crawler was slowly, but steadily increasing. As I hadn’t changed any significant portion of my code, this made no sense at all. Had I introduced a new bug? If so, where was it? Here follows the full story of how I tracked down a memory leak in my Python application. Note - Benoit Bernard is writing these long form articles on his debugging experiences it’s worth reading. (是也乎: 为了挖出来问题根源…. 应该使用火熖图了吧? ) Mypy 如何简化编译 Python 的 mypy The Mypy static type-checking project for Python is exploring ways it could aid with effortlessly compiling Python into C or machine language (是也乎: 一切为了编译为 C, 可是为毛?! ) Python Snippetizer snippets, website Python snippets for beginners to explore. Python 3.6 中的语法糖 python3.6 Simple code snippets showing us what’s new in Python 3.6. (是也乎: 这世界上语法糖最多的可能是 Ruby 语言了,然后呢?! ) Why I’m Making Python 2.8 placeholder For the past two months I’ve been spending half my time on Python 2.8. Python 2.8 is a backwards-compatible Python interpreter that runs Python 2 code and C-extensions exactly as-is, while also allowing Python 2 programmers to use the most exciting new language features from Python 3. These new backported language features include async/await syntax, function annotations and typing support, keyword-only arguments, and new metaclass syntax, among many others. I use Python 2.8 as my system python now, and haven’t had any problems running my old 2.7 code or using packages like IPython, pip, numpy, pandas, requests, and flask. (是也乎: 细思恐极,官方声称放弃 Py2 后,江湖中果断有英雄出面! 2.8 准备继承 Py 2 的遗产, 并成为可以同时运行 Py2和Py3 代码的更加兼容的环境! 已经编译出来的 Py2.8 运行当前所有重要的常见模块/框架都没有问题… ) 在 Python 中提高异常敏度- By Moshe Zadka exception handling There is a lot of Python code in the wild which does something like raise SomeException(“Could not fraz the buzz: {} is less than {}".format(foo, quux)). This is, in general, a bad idea. Exceptions are not program panics. 谁测试了什么 - By Ned Batchelder coverage The next big feature for coverage.py is what I informally call “Who Tests What.” People want a way to know more than just what lines were covered by the tests, but also, which tests covered which lines. (是也乎: 越来越关心具体的测试序列对应的覆盖行区块了… ) 好物 ~ 包/模块/库/片段… ...

2016-12-15 · 3 min · 1195 words · ZoomQuiet

蠎加载 102

原文: Import Python Weekly Newsletter - Issue No 102 欢迎, 来 PyChina/weekly 共同翻译/增订/推荐 周刊 蠎消息 ;-) 该读 ~ 文章, Blog, 教程… 如何用 Python 代码来捕获环线地铁上的流氓? pandas Singapore’s MRT Circle Line was hit by a spate of mysterious disruptions in recent months, causing much confusion and distress to thousands of commuters. Like most of my colleagues, I take a train on the Circle Line to my office at one-north every morning. So on November 5, when my team was given the chance to investigate the cause, I volunteered without hesitation. (是也乎: 通过一系列的数据分析,将非法乘车的人群行为可视化, 相关 ipynb 下载:datagovsg-blog/circle-line-analytics 问题是, 新加坡哪! 传说中治安最好的国家之一呢… ) 线程异步魔法以及具体的折腾 python3, asyncio A dive into Python’s asyncio tasks and event loops. The asyncio package allows us to define coroutines. These are code blocks that have the ability of yielding execution to other blocks. They run inside an event loop which iterates through the scheduled tasks and executes them one by one. A task switch occurs when it reaches an await statement or when the current task completes. (是也乎: Py3 也就只能将这拿来说事儿了 ) Python 加载语句中的命名约定.用 BigQuert 对 Github DB Dump 进行探索 github, bigquery Fun article by Florin Badita using BigQuery over entire github hosted Python project’s code base. (是也乎: 细思恐极~ GitHub Data | BigQuery Documentation | Google Cloud Platform GitHub 应该是拿到了 Google 的免费接口支持, 所以能实时的将所有开源项目的仓库数据同步到 BigQuery 上, 这带来了一个直接后果: 我们提交的代码已经变成了互联网意识的一部分! 嗯哼,各种代码代码风格的优劣,现在有了直接的数据支持,可以客观的知道当前世界上程序猿们的真实心理动态了…. 比如: 这个月使用 tab 的多过空格的, 可能是 win13 发布带来的小高潮…etc. Tabs or spaces(圣战分析) 当然有很多技巧的, 主表 [bigquery-public-data:github_repos.contents] 已经 1.5 TB, 不是一般人承担的了查询费用的… ) Tensorflow: 如何用 Python 接口冻结模型并使用 tensorflow, machinelearning We are going to explore two parts of using a ML model in production. How to export a model and have a simple self-sufficient file for it ? How to build a simple python server (using flask) to serve it with TF ?. (是也乎: 又一个用 Flask 落地 TF 服务的案例 ) 四大 Python 可能的未来之纠缠 What does the future hold for Python, aside from new versions of the language ? (是也乎: 嗯哼, Py2 LL&P ) 基于 Microsoft Cognitive 服务和 Python 构建私人 ChatBot chatbots ChatBot is the new buzz word for a while. Microsoft Cognitive Services API allows you to built ones that allow your app to process natural language and learn how to recognize what users want. (是也乎: 就是这种邪恶的免费接口,将程序猿训练为了向企业 AI 投食的机械人! 嗯哼,俺也将给 Cognitive 输入整个儿红楼梦,是否能变成可吟诗的 Bot ? ( ̄▽ ̄) 也支持 Jupyter … M$ 一点儿也不落后. ) 用 Python 可视化 Tweet 向量 data-mining, gensim, tweets I created a semi-practical application that reads from the Twitter stream, parses tweets, and does some machine learning magic to score the tweet’s sentiment and project it into a two-dimensional grid, where tweets with similar content will appear closer to each other. It does all of this more or less in real time using asynchronous messaging. (是也乎: 实时获得 Twitter 的情绪变化 ) 在 Xcode 中跑 Python : 步骤 — Erica Sadun xcode, apple As I’m preparing for a project that will involve Python programming, I need to get up to speed with at least a basic level of Python mastery. However, I’m not a big fan of using the interactive Python REPL. I decided to use Xcode instead, and I’m finding it a much better solution for my needs: (是也乎: Hummm 何苦泥… ) 用 Pickle 进行对象序列化 pickle Introductory article on usage of pickle module. (是也乎: 之前曰过 eevee/camel: Python serialization for adults 更加嗯哼. ) 和 AWS Lambda 一起用 Numba aws, lambda, numba In a recent project, we decided to use Lambda to execute some fairly math-y Python code in response to user click events on a webpage. Originally this back-end Python code had utilized the Numba library to speed up its execution. However, we quickly found that it was not trivial to make Lambda and Numba play nicely together. (是也乎: 事实一再证明 AWS 工程师不是吃素的… Numba 这种基于 LLVM 加速的并发分析工具,都可以简单的移植到 Lambda 中跑起来… ) unittest 中最赞的你应该知道却不一定知道的特性 subTest From time to time I like to read documentation of modules I think I know well. The python documentation is not a pleasant read but sometimes you strike a gem. (是也乎: 所谓灯下黑呗. 终于有子测试了… ) Pytho 中的高级句式匹配 string_maching FuzzyWuzzy is a fantastic Python package which uses a distance matching algorithm to calculate proximity measures between string entries. (是也乎: 使用距离算法来对整句进行相似度分析,当然不支持 中文先… ) 通过异常类定义另你的自制类更加可读 video, screencast, exception_handling In this short screencast I’ll walk you through a simple code example that demonstrates how you can use custom exception classes in your Python code to make it easier to understand, easier to debug, and more maintainable. (是也乎: 其实吧,还是代码写简单点儿最好了. ) 好物 ~ 包/模块/库/片段… ...

2016-12-10 · 4 min · 1890 words · ZoomQuiet