pewanalytics is a Python package that provides text processing and statistics utilities for computational social science researchers.

To install, you can use pip:

pip install git+https://github.com/pewresearch/pewanalytics#egg=pewanalytics

Or you can install from source:

git clone https://github.com/pewresearch/pewanalytics.git
cd pewanalytics
python setup.py install

Some of our libraries require the use of 64-bit Python. If you encounter errors during installation that are related to missing libraries, you may be using 32-bit Python. We recommend that you uninstall this version and switch to a 64-bit version instead. On Windows, these will be marked with x86-64; you can find the latest 64-bit versions of Python here.

ssdeep is an optional dependency that can be used by the get_hash function in Pewtils. Installation instructions for various Linux distributions can be found in the library's documentation. The ssdeep Python library is not currently compatible with Windows. Installing ssdeep on Mac OS may involve a few additional steps, detailed below:

1. Install Homebrew
2. Install xcode

   xcode-select --install
   

3. Install system dependencies

   brew install pkg-config libffi libtool automake
   ln -s /usr/local/bin/glibtoolize /usr/local/bin/libtoolize
   

4. Install ssdeep with an additional flag to build the required libraries

   BUILD_LIB=1 pip install ssdeep
   

5. If step 4 fails, you may need to redirect your system to the new libraries by setting the following flags:

   export LIBTOOL=`which glibtool`
   export LIBTOOLIZE=`which glibtoolize`
   

   Do this and try step 4 again.
6. Now you should be able to run the main installation process detailed above.

Please refer to the official documentation for information on how to use this package.

In addition to the license, Users must abide by the following conditions:

• User may not use the Center's logo
• User may not use the Center's name in any advertising, marketing or promotional materials.
• User may not use the licensed materials in any manner that implies, suggests, or could otherwise be perceived as attributing a particular policy or lobbying objective or opinion to the Center, or as a Center endorsement of a cause, candidate, issue, party, product, business, organization, religion or viewpoint.

This code is provided as-is for use in your own projects. You are free to submit issues and pull requests with any questions or suggestions you may have. We will do our best to respond within a 30-day time period.

Pew Research Center, 2020, "pewanalytics" Available at: github.com/pewresearch/pewanalytics

The following authors contributed to this repository:

• Patrick van Kessel
• Regina Widjaya
• Skye Toor
• Emma Remy
• Onyi Lam
• Brian Broderick
• Galen Stocking
• Dennis Quinn

Pew Research Center is a nonpartisan fact tank that informs the public about the issues, attitudes and trends shaping the world. It does not take policy positions. The Center conducts public opinion polling, demographic research, content analysis and other data-driven social science research. It studies U.S. politics and policy; journalism and media; internet, science and technology; religion and public life; Hispanic trends; global attitudes and trends; and U.S. social and demographic trends. All of the Center's reports are available at www.pewresearch.org. Pew Research Center is a subsidiary of The Pew Charitable Trusts, its primary funder.

For all inquiries, please email info@pewresearch.org. Please be sure to specify your deadline, and we will get back to you as soon as possible. This email account is monitored regularly by Pew Research Center Communications staff.