周刊

原文: Import Python Weekly Newsletter - Issue No 117 欢迎, 来 PyChina/weekly 共同翻译/增订/推荐 周刊 蠎消息 ;-) 该读 ~ 文章, Blog, 教程… Python 的 Memoization 以及 Decorators core-python With memoization, we can “memoize” (remember, store) the result of problems that we’ve dealt with before, and return a stored result instead of repeating calculations. (是也乎: 对计算的缓存.. ) 用 Apache Airflow 开始折腾工作流 airflow Apache Airflow is an open-source tool for orchestrating complex computational workflows and data processing pipelines. If you find yourself running cron task which execute ever longer scripts, or keeping a calendar of big data processing batch jobs then Airflow can probably help you. This article provides an introductory tutorial for people who want to get started writing pipelines with Airflow. 数据科学基本统计: Python 案例集, 第一部分 statistics In this post, we’ll take a step back to cover essential statistics that every data scientist should know. PyMedium PyMedium is an unofficial Medium API written in python flask. It provides developers to access to user, post list and detail information from Medium website. This is a read-only API to access public information from Medium, you can customize this API to fit your requirements and deploy on your own server. (是也乎: 又一个非法接口嗯哼出来了 ) TensorFlow 可视化: Summary 和 TensorBoard tensorflow This article is going to discuss some basic methods and functions in tensorflow used to visualize and monitor the training process. I believe visualization is top priority for the research. Because the deep learning itself is a “black box”. So, if the visualization could help us analyze why the final result is successful or failed. 用 Python, pandas 和线性回归模型 预测住房价格 pandas Pandas & Seaborn - 优雅地处理和可视化数据指南 pandas 折腾 Machine Learning Algorithms machine learning 破解虚拟内存 virtual memory 用 Apache Kafka 和 Python 构建分布式流系统 kafka (是也乎: ) 使用 HTML5 和 Flask 拖放文件 flask 如何使用 IBM Watson 的 语音-文本 功能来转录我们的课程 watson In this step by step guide we’ll show you how to transcribe an audio file using IBM Watson speech-to-text API and a little bit of Python. 如何生成 文本总结 - 介绍深度学习 machine learning, video I’ll show you how you can turn an article into a one-sentence summary in Python with the Keras machine learning library. We’ll go over word embeddings, encoder-decoder architecture, and the role of attention in learning theory. Python 用 Circle CI 进行持续集成 CI 如何在 ModelForm 中动态过滤 ModelChoice 的查询集? django Python 3.6.1 已发布 core-python 几分钟内在 GCP 构建无服务器 Python 应用 google cloud, cloud functions Google’s answer to aws lambda. Django Admin: 昂贵的 COUNT(*) 查询 admin If you have maintained a website with a huge amount of data, you probably already know that Django Admin can become very slow when the database table gets so large. If you log the SQL queries (either using Django logging or using Django Debug Toolbar), you would notice a very expensive SQL query, something like this. 好物 ~ 包/模块/库/片段… ...

原文: Import Python Weekly Newsletter - Issue No 115 欢迎, 来 PyChina/weekly 共同翻译/增订/推荐 周刊 蠎消息 ;-) 该读 ~ 文章, Blog, 教程… Worthy Read Fire 介绍 - 能自动生成 CLI 的嗯哼 - By Google CLI Today we are pleased to announce the open-sourcing of Python Fire. Python Fire generates command line interfaces (CLIs) from any Python code. Simply call the Fire function in any Python program to automatically turn that program into a CLI. The library is available from pypi via pip install fire, and the source is available on GitHub. (是也乎: 文档在 google/python-fire: Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object. 已经快 5000 星了… ) 用 Python 3.6 类型提示编写更好软件 type annotations Type annotations are a precious tool (especially if used in combination with an advanced IDE like PyCharm) that allow us to: write clear and implicitly documented code, prevent us from invoking methods with wrong data types (ok, actually we can do whatever at runtime since Python is a dynamic language and type hints as the name suggests is just that: an hint) and get useful code suggestions and autocompletion. (是也乎: 简单的说, 追加各种 C++ 式的特性, 就是为了将 IDE 卖的更好… ) 简单机器学习模型5行 Python 代码 machine learning We will test a simple Linear Regression Model by passing it training data and expecting correct output for a new input. 用 Facebook 的 Prophet Library 预测网站流量 machine learning, forecasting I was very interested to see that Facebook recently open sourced a python and R library called prophet which seeks to automate the forecasting process in a more sophisticated but easily tune-able model. In this article, I’ll introduce prophet and show how to use it to predict the volume of traffic in the next year for Practical Business Python. To make this a little more interesting, I will post the prediction through the end of March so we can take a look at how accurate the forecast is. (是也乎: Py+R 的一个实用库,或是说 PaaS ) Generator 清理 generators What happens if you close the generator instead of throwing an exception? (是也乎: 生成器关闭后… ) 俺的经验: 基于长运行时 芹菜 发布的微服务 celery While Celery is well-maintained, it’s not easy to find examples of advanced patterns of real-world usage. Also it’s often been difficult to find solutions to issues that we’ve come across. So I want to share some of our experiences. (是也乎: 又一个重病芹菜依赖症团队的嗯哼… ) 知识 Bootstrapping mindmap A little offtopic but enjoyed reading it. Do check https://github.com/nikitavoloboev/research/ Python 中使用 ctypes 导入:解决溢出问题 ctypes 在Jupyter可重复的数据分析 jupyter 使用Python构建微服务 第一部分 microservices Nowadays it is a common practice to work in smaller applications, sharing the responsibility among many different services. I believe it is critical to have some standard tools between the teams working solving those problems. Note here is the link to Part II https://medium.com/@ssola/building-microservices-with-python-part-2-9f951199094a 用 Python 寻找免费食物 scraping Postmates regularly does promotions where they offer free food and waive the delivery fee for certain restaurants. I recently realized that I could make this simpler by creating something that would track the Postmates website and notify me of deals. 用 Python 解析维基百科全数据 XML 转储 xml, parsing Note - My college project 11 years back did the same thing using C++. Today if I were to attempt the same problem I might look at using mapreduce / spark. (是也乎: 作者用 C++ 作过, 现在用 py 来… ) Python Datetime 获取月范围 datetime HackerRank 二元搜索: 冰淇淋店 algorithms 好物 ~ 包/模块/库/片段… ...

原文: Import Python Weekly Newsletter - Issue No 114 欢迎, 来 PyChina/weekly 共同翻译/增订/推荐 周刊 蠎消息 ;-) 该读 ~ 文章, Blog, 教程… QueueLogger 和 Python JSON Logger logging Logging from multiple processes. 从文本中提取特征 machine learning This is my first time writing blog post about anything Python related. I go over the differences and how to use CountVectorizer() and TfidfVectorizer() from sci-kit learn. I’d love to hear what you think. (是也乎: 笔者说是第一篇 py 相关的嗯哼… ) Python 周聊: Emoji: Revisited video, emoji Special guest Katie McLaughlin will answer your questions about emoji: unicode, compatibility, support, and more. 深层和层次隐式模型 tensorflow As a practical example, we show how you can take any standard neural network and turn it into a deep implicit model: simply inject noise into the hidden layers. The hidden units in these layers are now interpreted as latent variables. Further, the induced latent variables are astonishingly flexible, going beyond Gaussians (or exponential families (Ranganath, Tang, Charlin, & Blei, 2015)) to arbitrary probability distributions. Deep generative modeling could not be any simpler! (是也乎: 简单的说 tensorflow 都支持的 ) Pythonistas 想要的定制杯子/配件 merchandise Cool Coffee Mugs for Python Developers. Check it out. (是也乎: ) Postmodern Error Handling 在 Python 3.6 python3, error handling How to catch some TYPES of errors before they happen. (是也乎: 后现代错误处理…눈_눈 ) Pandas 和 Jeff Reback – Episode 98 podcast 使用Google幻灯片API添加文字和图形 - G 套件开发秀 video Using Python API (是也乎: 油管上的…当然的. 由陈姓大叔讲解… ) Ned Batchelder: A tale of two exceptions, continued exception handling How to Rotate Images in Python Using a Horizon Detection Algorithm image processing (是也乎: 每个月5000张免费使用…无法用在视频上哪… ) Staffjoy 刚刚开源了 open source Staffjoy is shutting down, so we are open-sourcing our code. This version of our V1, intended for on-demand companies and call centers, has been heavily modified so that Staffjoy customers may continue using the software. Prophet: 规模化预报 machine learning Prophet is a procedure for forecasting time series data. It is based on an additive model where non-linear trends are fit with yearly and weekly seasonality, plus holidays. It works best with daily periodicity data with at least one year of historical data. Prophet is robust to missing data, shifts in the trend, and large outliers. (是也乎: 基于时间序列的预警 ) 一致性哈希环的简单解释 hash Consistent hash rings are beautiful structures, yet often poorly explained. Implementations tend to focus on clever language-specific tricks, and theoretical approaches insist on befuddling it with math and tangents irrelevant. (是也乎: 别的不说, 这图作的美… ) Async HTTP 在 PyPy3 上的基准测试 pypy PythonBuddy editor Python Editor With Live Syntax Checking and Execution (是也乎: 丑… ) 好物 ~ 包/模块/库/片段… ...

原文: Import Python Weekly Newsletter - Issue No 113 欢迎, 来 PyChina/weekly 共同翻译/增订/推荐 周刊 蠎消息 ;-) 该读 ~ 文章, Blog, 教程… Guido van Rossum 访谈 podcast, BDFL Talkpython interview with Guido van Rossum aka BDFL. (是也乎: 有字幕的, 基本上就是回忆了 ABC 时代的嗯哼… ) 几个 Python 3 决择 / 进化 的关键视图 core-python The people who introduced me to Python chose it because of the elegance of the language, and it’s aesthetic qualities. Would they choose it again, I wonder? Would I?. (是也乎: 是什么以及为什么的 Py3 def hello_world(name): print ‘Hello’, name –> @coroutine async def hello_world(name: str) -> str: await print(‘Hello {}’.format(yield from name)) 一定是太多 C++ 程序媛进入了 python 内核开发团队! ) 在 Python 中设计模块 - ebook book This book is for people with some experience in an object oriented programming language. This book will help you get better at module/class level design. Hopefully, it will teach you to identify good design from bad. 为工程师和科学家的 Python 视频 video Python material in data science, analysis, and modeling, and optimization. Here is the youtube video channel of the site https://www.youtube.com/user/APMonitorCom (是也乎: 各种实战领域在职工程师/科学家们的 Pythonic 折腾 ) 使用 Uber 的 Pyflame 和日志解决问题 debugging This time, it was different though. My distributed web crawler seemed to be slowing down over time. Adding more nodes only had a temporary performance boost; the overall crawling speed gradually declined afterwards. So simply put, it couldn’t scale. But why?. In this post, you’ll find out what techniques and tools I used to diagnose scaling issues - and to an extent, more general performance issues - in my Python-based web crawler. (是也乎: 火焰图…. OpenResty 内置了专用工具, 现在咱大蠎也有了… ) Python Packaging 简要指南 packaging Code reuse is a very common need. It saves you time for writing the same code multiple times, enables leveraging other smart people’s work to make new things happen. Even just for one project, it helps organize code in a modular way so you can maintain each part separately. When it comes to python, it means format your project so it can be easily packaged. This is a simple instruction on how to go from nothing to a package that you can proudly put it in your portfolio to be used by other people. (是也乎: 一切最终归向 pypi ,这样有问题哪… ) 闭包约束 closures Emacs 作为 Python IDE emacs Note - The video is old, but worth watching for emacs users. 一种用于肺癌检测的python解决方案 deep learning 使用 Python 查找损坏的图像 image processing 5种 Python 库轻松进入机​​器学习 machine learning PyWren, Tfdeploy, Luigi, Kubelib, PyTorch. Note - We used luigi at my previous workplace and it’s a solid library to custom pipelines for batch processing. In our case it was used to enforce database migrations. 类型跟踪对Python很有用 debugging Type Tracing - as a program runs you trace it and record the types of variables coming in and out of functions, and being assigned to variables. (是也乎: 嗯哼?! 真正靠谱的还是人 ) 使用 Python 对扫描文档进行数据挖掘 data mining I’ve written a Python package called pdftabextract https://github.com/WZBSocialScienceCenter/pdftabextract that contains several helpful functions for that task and I’m explaining how to use them in that blog post. 好物 ~ 包/模块/库/片段… ...