Articles by hrbrmstr

Mapping Tornado Alley with R

May 18, 2019 | hrbrmstr

I caught a re-tweet of this tweet by @harry_stevens: THREAD: I wrote a post on @observablehq about a map I made today. It shows a typical day in the life of a graphics journalist: You never know what problems you'll have to solve on deadline! https://t.co/yRhW1...

[Read more...]

Quick Hit: Updates to QuickLookR and {rdatainfo}

May 12, 2019 | hrbrmstr

I’m using GitUgh links here b/c the issue was submitted there. Those not wishing to be surveilled by Microsoft can find the macOS QuickLook plugin project and {rdatainfo} project in SourceHut and GitLab (~hrbrmstr and hrbrmstr accounts respectively). I hadn’t touched QuickLookR???? or {rdatainfo}???? at all since 2016 ...

[Read more...]

Quick Hit: Scraping javascript-“enabled” Sites with {htmlunit}

April 27, 2019 | hrbrmstr

I’ve mentioned {htmlunit} in passing before, but did not put any code in the blog post. Since I just updated {htmlunitjars} to the latest and greatest version, now might be a good time to do a quick demo of it. The {htmlunit}/{htmunitjars} packages make the functionality of the ...

[Read more...]

Lost In [SQL] Translation: Charting d[b]plyr Mapped SQL Function Support Across All Backends

April 10, 2019 | hrbrmstr

Like more posts than I care to admit, this one starts innocently enough with a tweet by @gshotwell: Is there a reference document somewhere of which dplyr commands work on various database backends? #rstats — Gordon Shotwell (@gshotwell) April 9, 2019 Since I use at least 4 different d[b]plyr backends every week, ...

[Read more...]

A Limited-but-Functional Couchbase Free Text Search & Retrieval Un-package; or, “How I Abused Couchbase & R to Perform Bulk IP Whois Full-text Searches” (a Cobbler’s Tale)

April 7, 2019 | hrbrmstr

Researching “the internet” (i.e. $DAYJOB) means having to deal with a ton of “unique” (I’m being kind) data formats. This is ultimately a tale of how I performed full-text searches across one of them. It all started off innocently enough. This past week I need to be able ...

[Read more...]

Wicked Fast, Accurate Quantiles Using ‘t-Digests’ in R with the {tdigest} Package

April 3, 2019 | hrbrmstr

@ted_dunning recently updated the t-Digest algorithm he created back in 2013. What is this “t-digest”? Fundamentally, it is a probabilistic data structure for estimating any percentile of distributed/streaming data. Ted explains it quite elegantly in this short video: Said video has a full transcript as well. T-digests have been ... [Read more...]

Rome Was Not Built In A Day But widgetcard Was!

March 26, 2019 | hrbrmstr

I saw a second post on turning htmlwidgets into interactive Twitter Player cards and felt somewhat compelled to make creating said entities a bit easier so posited the following: Wld this be useful packaged up, #rstats?https://t.co/sfqlWnEeJVhttps://t.co/troKzmzTNv (TLDR/V: Single function to turn an ...

[Read more...]

Assumptions Matter More Than Dependencies

March 18, 2019 | hrbrmstr

There’s been alot of talk about “dependencies” in the R universe of late. This is not really a post about that but more of a “really, don’t do this” if you decide you want to poke the dependency bear by trying to build a deeply flawed model off ... [Read more...]

Handling & Sharing PCAPs Like a Boss with PacketTotal

March 17, 2019 | hrbrmstr

The fine folks over at @PacketTotal bequeathed an API token on me so I cranked out an R package for it to enable more dynamic investigations work (RStudio makes for an amazing incident responder investigations console given that you can script in multiple languages, code in C[++], and write documentation ... [Read more...]

Collecting Content Security Policy Violation Reports in S3 (‘Effortlessly’/’Freely’)

March 14, 2019 | hrbrmstr

In the previous post I tried to explain what Content Security Policies (CSPs) are and how to work with them in R. In case you didn’t RTFPost the TLDR is that CSPs give you control over what can be loaded along with your web content and can optionally be ... [Read more...]

Wrangling Content Security Policies in R

March 10, 2019 | hrbrmstr

(header image via MDN Web Docs) The past two posts have used R to look at the safety/security (just assume those terms are in scare quotes from now on in every post) of web-y thing-ys. We’ll continue that theme with this post where we focus on a [sadly ...

[Read more...]

Head’s Up! Roll Your Own HTTP Headers Investigations with the ‘hdrs’ Package

March 5, 2019 | hrbrmstr

I blathered alot about HTTP headers in the last post. In the event you wanted to dig deeper I threw together a small package that will let you grab HTTP headers from a given URL and take a look at them. The README has examples for most things but we’...

[Read more...]

CRAN Mirror “Security”

March 3, 2019 | hrbrmstr

In the “Changes on CRAN” section of the latest version of the The R Journal (Vol. 10/2, December 2018) had this short blurb entitled “CRAN mirror security”: Currently, there are 100 official CRAN mirrors, 68 of which provide both secure downloads via ‘https’ and use secure mirroring from the CRAN master (via rsync through ...

[Read more...]

htmlunitjars Updated to 2.34.0

February 28, 2019 | hrbrmstr

The in-dev htmlunit package for javascript-“enabled” web-scraping without the need for Selenium, Splash or headless Chrome relies on the HtmlUnit library and said library just released version 2.34.0 with a wide array of changes that should make it possible to scrape more gnarly javascript-“enabled” sites. The Chrome emulation is ... [Read more...]

drat All The ?! : Enabling Easier Package Discovery and Installation with Your Own CRAN-like Repo for Your Packages

February 28, 2019 | hrbrmstr

I’ve got a work-in-progress drat-ified CRAN-like repo for (eventually) all my packages over at CINC? (“CINC is not CRAN” and it also sounds like “sync”). This is in parallel with a co-location/migration of all my packages to SourceHut (just waiting for the sr.ht alpha API to be ...

[Read more...]

Cloudy with a chance of Caffeinated Query Orchestration – New rJava Wrappers for AWS Athena SDK for Java

February 22, 2019 | hrbrmstr

There are two fledgling rJava-based R packages that enable working with the AWS SDK for Athena: awsathena | GL| GH awsathenajars | GL| GH They’re both needed to conform with the way CRAN like rJava-based packages submitted that also have large JAR dependencies. The goal is to eventually have wrappers for ... [Read more...]

I Just Wanted The Data : Turning Tableau & Tidyverse Tears Into Smiles with Base R (An Encoding Detective Story)

February 19, 2019 | hrbrmstr

Those outside the Colonies may not know that Payless—a national chain that made footwear affordable for millions of ‘Muricans who can’t spare $100.00 USD for a pair of shoes their 7 year old will outgrow in a year— is closing. CNBC also had a story that featured a choropleth with ...

[Read more...]

In Dev: WiGLE Your Way Into A Hotspot with wiglr

February 18, 2019 | hrbrmstr

WiGLE has been around a while and is a great site to explore the pervasiveness or sparsity of Wi-Fi (and cellular) networks around the globe. While interactive use is fun, WiGLE also has a free API (so long as you obey the EULA and aren’t abusive) that lets you ...

[Read more...]

Conquering Caffeinated Amazon Athena with the metis Trio of Packages

February 17, 2019 | hrbrmstr

I must preface this post with the posit that if you’re doing anything interactive() with Amazon Athena you should seriously consider just using their free ODBC drivers as it’s the easiest way to wire them up to R DBI- and tidyverse-wise. I’ve said as much in previous ...

[Read more...]

Using the ropendata R Package to Access Petabytes of Free Internet Telemetry Data from Rapid7

February 14, 2019 | hrbrmstr

I’ve got a post up over at $DAYJOB’s blog on using the ropendata???? package to access the ginormous and ever-increasing amount of internet telemetry (scan) data via the Rapid7 Open Data API. It’s super-R-code-heavy but renders surprisingly well in Ghost (the blogging platform we use at work) ... [Read more...]

« 1 … 3 4 5 6 7 … 21 »

R-bloggers

R news and tutorials contributed by hundreds of R bloggers

Articles by hrbrmstr

Mapping Tornado Alley with R

Quick Hit: Updates to QuickLookR and {rdatainfo}

Quick Hit: Scraping javascript-“enabled” Sites with {htmlunit}

Lost In [SQL] Translation: Charting d[b]plyr Mapped SQL Function Support Across All Backends

A Limited-but-Functional Couchbase Free Text Search & Retrieval Un-package; or, “How I Abused Couchbase & R to Perform Bulk IP Whois Full-text Searches” (a Cobbler’s Tale)

Wicked Fast, Accurate Quantiles Using ‘t-Digests’ in R with the {tdigest} Package

Rome Was Not Built In A Day But widgetcard Was!

Assumptions Matter More Than Dependencies

Handling & Sharing PCAPs Like a Boss with PacketTotal

Collecting Content Security Policy Violation Reports in S3 (‘Effortlessly’/’Freely’)

Wrangling Content Security Policies in R

Head’s Up! Roll Your Own HTTP Headers Investigations with the ‘hdrs’ Package

CRAN Mirror “Security”

htmlunitjars Updated to 2.34.0

drat All The ?! : Enabling Easier Package Discovery and Installation with Your Own CRAN-like Repo for Your Packages

Cloudy with a chance of Caffeinated Query Orchestration – New rJava Wrappers for AWS Athena SDK for Java

I Just Wanted The Data : Turning Tableau & Tidyverse Tears Into Smiles with Base R (An Encoding Detective Story)

In Dev: WiGLE Your Way Into A Hotspot with wiglr

Conquering Caffeinated Amazon Athena with the metis Trio of Packages

Using the ropendata R Package to Access Petabytes of Free Internet Telemetry Data from Rapid7

Articles by hrbrmstr

Never miss an update! Subscribe to R-bloggers to receive e-mails with the latest R posts. (You will not see this message again.)

Never miss an update!
Subscribe to R-bloggers to receive
e-mails with the latest R posts.
(You will not see this message again.)