Mining Twitter Data with Python (Part 1: Collecting data)

Marco Bonzanini

Twitter is a popular social network where users can share short SMS-like messages called tweets. Users share thoughts, links and pictures on Twitter, journalists comment on live events, companies promote products and engage with customers. The list of different ways to use Twitter could be really long, and with 500 millions of tweets per day, there’s a lot of data to analyse and to play with.

This is the first in a series of articles dedicated to mining data on Twitter using Python. In this first part, we’ll see different options to collect data from Twitter. Once we have built a data set, in the next episodes we’ll discuss some interesting data applications.

Update July 2016: my new book on data mining for Social Media is out! Part of the content in this tutorial has been improved and expanded as part of the book, so please have a…

View original post 914 more words

July 17, 2020: 1,002 new cases, $1.25 in business funding and 58 percent tax revenue

via July 17, 2020: 1,002 new cases, $1.25 in business funding and 58 percent tax revenue

Why herd immunity to COVID-19 is reached much earlier than thought

Climate Etc.

By Nic Lewis

Introduction

A study published in March by the COVID-19 Response Team from Imperial College (Ferguson20[1]) appears to have been largely responsible for driving government actions in the UK and, to a fair extent, in the US and some other countries. Until that report came out, the strategy of the UK government, at least, seems to have been to rely on the build up of ‘herd immunity’ to slow the growth of the epidemic and eventually cause it to peter out.

View original post 3,027 more words

Why is change discovery important for open data?

Lost Boy

Change discovery is the process of identifying changes to a resource. For example, that a document has been updated. Or, in the case of a dataset, whether some part of the data has been amended, e.g. to add data, fill in missing values, or correct existing data. If we can identify that changes have been made to a dataset, then we can update our locally cached copies, re-run analyses or generate new, enriched versions of the original.

Any developer who is building more than a disposable prototype will be looking for information about the ongoing stability and change frequency of a dataset. Typical questions might be:

• How often will a dataset get routinely updated and republished?
• What types of data updates are anticipated? E.g. are only new records added, or might data be amended and removed?
• How will the dataset, or parts of it be version controlled?
• How will changes…

View original post 880 more words

Comments on COVID-19

mathbabe

I am, like you, restless and having trouble coping with the tragedy going on. It’s especially hard to think through the logical details of issues that only two weeks ago seemed urgently important. So instead, like you, I find myself with an internal dialogue of how the publicized statistics are consistently biased or wrong. At the risk of simply supporting your own internal thoughts, here are a few of mine:

1. We still aren’t testing people, even in New York, which is the most tested population in the current mostly highly infected country according to the crap data we have.
2. What that means to me is that we can ballpark how many actual cases we have if we know what the condition is for actually getting tested. In New York, it’s something close to “needs hospitalization.” Considering that only about the worst 10% of cases in countries that do widespread testing…

View original post 447 more words

Roanoke Island Series

via Roanoke Island Series

Virginia Dyslexia Advisors in Every District

Introspection, Growth and Passion

via Introspection, Growth and Passion

Introspection, Growth and Passion

blog.phpdev

Having a moment of introspection this morning, thinking back over the years of how my work has changed – sometimes in pretty dramatic ways. It seems like forever ago that I was fresh out of school and working my first real programming job at a domain host. I worked hard until I was ultimately let go from the role due to some interpersonal issues. Fortunately, the market was good and I found a new role with a natural gas provider relatively quickly. I did a lot of growing there, not only in my skills but just in my understanding of how business gets done. It was while I was there that I got married and soon had to figure out how to juggle work and kids, finally getting it down about the time the second one came around.

All the while, I was still working on my passion – programming…

View original post 1,512 more words

Retrieve all table names of SQL Server DB with PHP on WAMP

via Retrieve all table names of SQL Server DB with PHP on WAMP