Package: castarter 0.3.0.9015

castarter: Content Analysis Starter Toolkit

Consistent approaches for basic web scraping, text mining and word frequency analysis of textual datasets.

Authors:Giorgio Comai [aut, cre, cph], EDJNet [fnd]

castarter_0.3.0.9015.tar.gz
castarter_0.3.0.9015.zip(r-4.7)castarter_0.3.0.9015.zip(r-4.6)castarter_0.3.0.9015.zip(r-4.5)
castarter_0.3.0.9015.tgz(r-4.6-any)castarter_0.3.0.9015.tgz(r-4.5-any)
castarter_0.3.0.9015.tar.gz(r-4.7-any)castarter_0.3.0.9015.tar.gz(r-4.6-any)
castarter_0.3.0.9015.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
DESCRIPTION |NEWS
card.svg |card.png
castarter/json (API)

# Install 'castarter' in R:
install.packages('castarter', repos = c('https://giocomai.r-universe.dev', 'https://cloud.r-project.org'))

Bug tracker:https://github.com/giocomai/castarter/issues

Pkgdown/docs site:https://castarter.tadadit.xyz

Datasets:

On CRAN:

Conda:

tadatext-mining

5.01 score 6 stars 2 scripts 107 exports 139 dependencies

Last updated from:f0befcb8d6. Checks:7 WARNING, 2 OK. Indexed: yes.

TargetResultTimeFilesSyslog
linux-devel-x86_64WARNING193
source / vignettesOK280
linux-release-x86_64WARNING178
macos-release-arm64WARNING97
macos-oldrel-arm64WARNING87
windows-develWARNING123
windows-releaseWARNING232
windows-oldrelWARNING148
wasm-releaseOK152

Exports::=.data%>%as_labelas_namecas_archivecas_backup_gdcas_browsecas_build_urlscas_check_corpuscas_check_db_foldercas_check_read_db_contents_datacas_check_responsecas_check_use_dbcas_check_website_foldercas_connect_to_dbcas_convert_db_typecas_countcas_count_relativecas_count_total_wordscas_create_db_foldercas_delete_corpuscas_delete_from_dbcas_disable_dbcas_disconnect_from_dbcas_downloadcas_download_chromotecas_download_httrcas_download_httr2cas_download_indexcas_download_internalcas_enable_dbcas_explorercas_export_tablescas_extractcas_extract_htmlcas_extract_html_customcas_extract_linkscas_extract_scriptcas_find_extractorcas_generate_metadatacas_get_base_foldercas_get_base_pathcas_get_corpus_pathcas_get_dbcas_get_db_filecas_get_db_foldercas_get_db_settingscas_get_files_to_downloadcas_get_files_to_extractcas_get_optionscas_get_path_to_filescas_get_sitemapcas_get_urls_dfcas_get_website_foldercas_ia_checkcas_ia_savecas_ignore_idcas_kwiccas_kwic_single_patterncas_read_corpuscas_read_db_contents_datacas_read_db_contents_idcas_read_db_downloadcas_read_db_iacas_read_db_ignore_idcas_read_db_indexcas_read_db_responsecas_read_db_sitemapcas_read_db_urlscas_read_from_dbcas_reset_dbcas_reset_db_contents_datacas_reset_db_contents_idcas_reset_db_ignore_idcas_reset_db_index_idcas_reset_download_contentscas_reset_download_indexcas_restorecas_set_dbcas_set_db_foldercas_set_optionscas_show_barchart_ggiraphcas_show_barchart_ggplot2cas_show_gg_basecas_show_ts_dygraphcas_summarisecas_updatecas_write_corpuscas_write_db_contents_datacas_write_db_contents_idcas_write_db_ignore_idcas_write_db_indexcas_write_db_sitemapcas_write_db_urlscas_write_to_dbcass_build_urlscass_combine_into_patterncass_download_csv_appcass_highlightcass_show_ts_dygraph_appcass_split_stringenquoenquosexprsymsyms

Dependencies:askpassassertthatattemptbase64encbitbit64blobbslibcachemcallrciceroneclicliprcommonmarkconfigcpp11crayoncredentialscrosstalkcurlDBIdbplyrdescdigestdplyrDTdygraphsellipsisevaluatefarverfastmapfontawesomefontBitstreamVerafontLiberationfontquiverforcatsfsgdtoolsgenericsgertggiraphggplot2ghgitcredsgluegolemgtableherehighrhmshtmltoolshtmlwidgetshttpuvhttrhttr2iniisobandjaneaustenrjquerylibjsonliteknitrlabelinglaterlatticelazyevallifecyclelubridatemagrittrMASSMatrixmemoisemimeopensslotelpillarpkgconfigPrettyColsprettyunitsprocessxprogresspromisespspurrrR.cacheR.methodsS3R.ooR.utilsR6rappdirsRColorBrewerRcppreactablereactRreadrrlangrmarkdownrprojrootRSQLiterstudioapirvestS7sassscalesselectrshinyshinymetasliderSnowballCsourcetoolsstringistringrstylersyssystemfontstbl2xtstibbletidyrtidyselecttidytexttimechangetinytextokenizerstzdbusethisutf8vctrsviridisLitevroomwaiterwarpwhiskerwithrxfunxml2xtablextsyamlzipzoo

Shiny modules included in castarter
Time series | Dygraphs | Barchart
Rendered fromcastarter-shiny-modules.Rmdusingknitr::rmarkdown

Last update: 2026-02-07
Started: 2022-12-11

Database structure in castarter
Database location and database file naming conventions | Main database tables and column names | Additional tables
Rendered fromcastarter-database.Rmdusingknitr::rmarkdown

Last update: 2023-12-24
Started: 2022-12-11

Readme and manuals

Help Manual

Help pageTopics
Archive originals of downloaded files in compressed folderscas_archive
Backup files to Google Drivecas_backup_gd
Open in a browser a URL stored in the local databasecas_browse
URL buildercas_build_urls
Checks if given corpus exists, and, optionally updates itcas_check_corpus
Checks if database folder exists, if not returns an informative messagecas_check_db_folder
Returns a corpus from the 'contents_data' table in the database; if corpus is given, it just returns that instead.cas_check_read_db_contents_data
Check httr response code and cache locally resultscas_check_response
Check caching status in the current session, and override it upon requestcas_check_use_db
Checks if current website folder existscas_check_website_folder
Return a connection to be used for cachingcas_connect_to_db
Convert database type, e.g. from DuckDB to SQLitecas_convert_db_type
Count strings in a corpuscas_count
Count strings in a corpus relative to the number of wordscas_count_relative
Count total words in a datasetcas_count_total_words
Creates the base folder where 'castarter' stores the project database.cas_create_db_folder
Delete previously stored corpora written with 'cas_write_corpus()'.cas_delete_corpus
Delete rows from selected database tablecas_delete_from_db
Disable caching for the current sessioncas_disable_db
Ensure that connection to database is disconnected consistentlycas_disconnect_from_db
Downloads files systematically, and stores details about the download in a local databasecas_download
Downloads one file at a time with 'chromote'cas_download_chromote
Downloads one file at a time with httrcas_download_httr
Downloads one file at a time with 'httr2'cas_download_httr2
Downloads index files systematically, and stores details about the download in a local databasecas_download_index
Downloads one file at a time with the default R function for downloading filescas_download_internal
Enable caching for the current sessioncas_enable_db
Run a web interface allowing basic word frequency analysiscas_explorer
Export database tables to another format such as csvcas_export_tables
Extract fields and contents from downloaded filescas_extract
Facilitates extraction of contents from an html filecas_extract_html
Facilitates extraction of contents from an html filecas_extract_html_custom
Extract direct links to individual content pages from index pagescas_extract_links
Extracts scripts from an html pagecas_extract_script
Facilitate finding extractors, typically to be used with 'cas_extract_html()'cas_find_extractor
Generate basic metadata about the corpus, including start and end date and total number of items available.cas_generate_metadata
Get base folder under which files will be stored.cas_get_base_folder
Build full path to base folder where batches of files will be stored.cas_get_base_path
Get path to folder where the corpus is stored.cas_get_corpus_path
Get connection to database with details about current websitecas_get_db
Gets location of database filecas_get_db_file
Get database connection settings from the environmentcas_get_db_settings
Create a data frame with not yet downloaded filescas_get_files_to_download
Get path to (locally available) files to be extractedcas_get_files_to_extract
Get key project parameters that determine the folder used for storing project filescas_get_options
Get path to locally downloaded filescas_get_path_to_files
Checks for availability of a sitemap in xml format.cas_get_sitemap
Checks that a given input corresponds to the format expected of a download data frame, consistently returns expected formatcas_get_urls_df
Get folder were files and data related to the current website are storedcas_get_website_folder
Gets an Archive.org Wayback Machine URLcas_ia_check
Save a URL the Internet Archive's Wayback Machinecas_ia_save
Adds a column with n words before and after the selected pattern to see keywords in contextcas_kwic
Adds a column with n words before and after the selected pattern to see keywords in contextcas_kwic_single_pattern
Read datasets created with 'cas_write_dataset'cas_read_corpus
Read contents data from local databasecas_read_db_contents_data
Read contents from local databasecas_read_db_contents_id
Read index from local databasecas_read_db_download
Read status on the Internet Archive of given URLscas_read_db_ia
Read identifiers to be ignored from the local databasecas_read_db_ignore_id
Read index from local databasecas_read_db_index
Check response type of URLs as stored in the local database.cas_read_db_response
Read sitemap from local databasecas_read_db_sitemap
Read urls stored in the local databasecas_read_db_urls
Reads data from local databasecas_read_from_db
Delete a specific table from databasecas_reset_db
Removes from the local database the folder where extracted data are storedcas_reset_db_contents_data
Removes from the local database the folder where links to contents associated with their id are storedcas_reset_db_contents_id
Removes from the local database all identifiers included in the ignore listcas_reset_db_ignore_id
Removes from the local database the table where links to index urls are storedcas_reset_db_index_id
Delete all files and database records for the contents pages of the current websitecas_reset_download_contents
Delete all files and database records for the index pages of the current websitecas_reset_download_index
Restore files from compressed filescas_restore
Set database connection settings for the sessioncas_set_db
Set folder for storing the databasecas_get_db_folder cas_set_db_folder
Set key project parameters that determine the folder used for storing project filescas_set_options
Creates interacative barchart with ggiraphcas_show_barchart_ggiraph
Creates barchart with ggplot2cas_show_barchart_ggplot2
Creates base ggplot2 object to be used by ggplot or ggiraphcas_show_gg_base
Create dygraphs based on a data frame typically generated with 'cas_count()'cas_show_ts_dygraph
Summarise for a given time period word counts, typically calculatd with 'cas_count()'cas_summarise
Update corpuscas_update
Export the textual dataset for the current websitecas_write_corpus
Write extracted contents to local databasecas_write_db_contents_data
Write contents URLs to local databasecas_write_db_contents_id
Ignore a set of ids from the download or processing stepcas_ignore_id cas_write_db_ignore_id
Write index URLs to local databasecas_write_db_index
Write index URLs to local databasecas_write_db_sitemap
Write index or contents urls directly to the local databasecas_write_db_urls
Generic function for writing to databasecas_write_to_db
Empty data frame with the same format as data stored in the 'index_id' tablecasdb_empty_index_id
Helps you define the parameters you need for building index urlscass_build_urls
A minimal shiny app that demonstrates the functioning of related modulescass_download_csv_app
Takes a character vector and returns it with matches of pattern wrapped in html tags used for highlightingcass_highlight
A minimal shiny app that demonstrates the functioning of related modulescass_show_ts_dygraph_app
Split string into multiple inputscass_split_string