Word Frequency Analysis Project for 36000 Book Title Records

This project is a text data analysis project. The goal of the project is to convert a file containing 36,000 book authors into a table of unique “wildcard” search terms ranked by their frequency. A “wildcard” search term is a character string ending in an asterisk. For example, the characters “ins*” would be a wildcard search term. When submitted into a search engine that accepts wildcards, “ins*” would return any word starting with the characters “ins”. For example, “insurance”, “insulation”, “instance”, etc. The project will involve the following main steps: * Parse the set of 36,000 book authors into separate words so that each word is a separate record. * Remove from the set all words with less than three characters. * Modify the set of words so that only the first three characters of each word are kept (each word will now be abbreviated to only the first three characters). * Create a new table that will list each unique three character abbreviation on a separate record with a separate “Quantity” field indicating the number of times each unique three character abbreviation appears in the original list. * Add an asterisk to the end of each three character abbreviation in order to convert the abbreviations into three character wildcard search terms. Please see the attached file for full project specifications including an example set and the full input file containing 36000 book title records.