🦋 Welcome to the MAIN() IRC channel of the Raku Programming Language (raku.org). Log available at irclogs.raku.org/raku/live.html . If you're a beginner, you can also check out the #raku-beginner channel!
Set by lizmat on 6 September 2022.
Geth ecosystem/main: a0289eebc7 | (Elizabeth Mattijsen)++ | META.list
Remove Testo

it lives in the zef ecosystem now
09:46
tbrowder__ tonyo: happy new year! pm? 11:56
nemokosch so Testo did jump up haha 12:13
hankache m: say "Hello Raku" 15:59
camelia Hello Raku
lizmat hankache o/ 16:01
long time no see!
hankache hi lizmat, indeed! I hope all is well 16:02
lizmat yeah, within parameters :-)
hankache :)
lizmat I hope all is well with you as well, in your corner of the world
hankache all good 16:04
[Coke] Allo 16:59
antononcube @Coke Halo 17:09
tonyo tbrowder__: happy new years! you're always welcome to hit me with a pm 18:10
tonyo librasteve antoncube, fwiw i generally use the python libs for scraping. the perl one has some issues, or did when i was using it to scrape google flights prices 18:11
jdv mojo hasbeen good for me for static scrapes 18:35
otherwise puppeteer 18:36
lately
tonyo static scrapes i just use perl's web::scraper 19:53
or rakus, but it's pretty rare for me to scrape static pages
in fact, since i wrote raku's 19:54
librasteve ah, which python scraper do your prefer? 19:59
tonyo i use selenium with python 20:05
librasteve okay - tx! 20:07
[meaning I have been going that way myself so may be able to work up raku-selenium] 20:09
which driver do you use?
tonyo i use the chrome driver, have also used FF but i use FF personally so i try to use chrome to avoid any mix of the two 20:11
use FF personally for regular web browsing
antononcube @tonyo I cannot install "Web::Scraper" on macOS. (Installation hangs.) Should file an issue on GitHub? 20:18
[Coke] I think the hang might be due to the old URLS in t/02_http.t 20:40
oh, sorry, we're not pulling those from the web, but from another file 20:41
it's hanging on the scrape() call 20:42
antononcube @Coke Thanks! 20:53
tonyo yea it might just take a really long time, yea you can add an issue and i'll take a look when i have time
antononcube ok 20:58
[Coke] I started one running with a timer and we'll see. 21:02
(I'm on an m2 here.)
it is chewing a single CPU, so something's happening 21:03
tonyo iirc the html normalzation takes a while 21:49
it's likely due for an overhaul now that libxml bindings exist