timotimo | looks like incorrect fudging? | 00:06 | |
i.e. it reaches the end, but it doesn't reach the specified amount of tests | 00:07 | ||
(file-ops.t) | |||
samcv | yay appveyor | 00:59 | |
can we install clang on windows | |||
well of course we can. will be cool to do coverage there too. | 01:00 | ||
when i'm feeling really masochistic maybe i'll do that | |||
"Perl: As Perl developers continue to wait for the arrival of Perl 6, other languages have seized the spotlight. Though some developers still find this language efficient and portable, it’s not without its annoyances. The popularity of Perl is fading fast and, unless Perl 6 is introduced soon, the demand for this technology may die out." | 01:17 | ||
oh my | |||
[Coke] | .seen samcv | 01:23 | |
yoleaux2 | I saw samcv 01:17Z in #moarvm: <samcv> oh my | ||
samcv | hi | ||
[Coke] | pmsged | ||
02:20
geekosaur joined
02:26
evalable6_ joined
02:59
evalable6 joined
04:14
evalable6 joined
05:21
stmuk joined
05:53
domidumont joined
05:59
domidumont joined
06:05
brrt joined
06:42
brrt joined
|
|||
brrt | timotimo: the other solution is to install gnu make or bsd make :-P | 06:52 | |
or mingw | |||
07:54
zakharyas joined
|
|||
samcv | oh guys | 08:12 | |
i have roast coverage reports now too | 08:13 | ||
brrt | hi samcv | 08:52 | |
samcv | if you guys curious | ||
Roast: line based (per file) cry.nu/coverage/roast/ | 08:53 | ||
function and file summaries of coverage % cry.nu/coverage/roast.html | |||
really nice, you can see which code doesn't get executed which can sometimes be insightful | |||
meaning not just code that is not tested, but code that may never execute or maybe was created with conditions in mind that may not actually happen | 08:54 | ||
brrt | huh, that's pretty funny | 08:56 | |
samcv | funny? | ||
also for #define's it will show the number of times code USING that thing has been run | 08:57 | ||
which is pretty mindblowing. but | |||
i verified it | |||
08:59
dogbert17 joined
|
|||
samcv | brrt, maybe you will find something interesting | 09:13 | |
brrt | funny as in interesting :-) | ||
samcv | brrt, cry.nu/coverage/roast/coverage/hom...log.c.html | 09:14 | |
maybe should inline that | |||
69.1M invocations. one of the highest i've seen | |||
brrt | hmm | 09:16 | |
the jit logging needs to be cleaned up anyway | |||
samcv | interesting here cry.nu/coverage/roast/coverage/hom...ile.h.html | ||
see how it shows the number of uses of that one define | |||
and the other one has no uses. and i used a grep and it is actually used never | 09:17 | ||
found (refound?) some functions in normalize.c that used to be used to determine regional codepoints and spacing marks but no longer are needed. so prolly gonna remove the spacing mark one. since it doesn't have much use. and the code inside it is sub-optimial | 09:19 | ||
err that's in anotherfile. but regardless. heh. found some code in normalize.c that i thought never would get executed/never understood why it was there. and turns out it doesn't execute lol | 09:21 | ||
or maybe it is needed, idk. just i guess we've never used the function in that situation | |||
timotimo | at first i thought "roast line based per file" meant you had one whole coverage report for every roastfile | 09:34 | |
that'd be a firehose of information; i'd expect we'd have to bucket it for it to make sense | 09:41 | ||
like, roast file 01-foo/bar.t covers 10 files at 0%, 7 files at up to 10%, 9 files at up to 20%, ... | |||
samcv | i do timotimo | 09:42 | |
but it's not online | |||
timotimo | oh | ||
samcv | i can make it if you want XD | ||
timotimo | is it many gigabytes big? :) | ||
samcv | idk | ||
timotimo | i'm not sure if it'd actually be helpful | ||
samcv | when roast runs it generates them in a directory format similar to roast itself | 09:43 | |
09:43
dalek joined
|
|||
samcv | but they are in coverage/t/spec/S05-blah/mything.t.covraw (or whatever the extension is i forget) | 09:43 | |
then i merge all of them together in the t/spec folder (so i only get profiles for roast files) | |||
it takes the 1st command line argument passed to perl6-m so i have lots of weirdly named ones not in any folder | 09:44 | ||
--help.profraw -IGNOREME.profraw lol | |||
timotimo | ugh :) | ||
samcv | but all the roast ones are nicely in folders exactly how they are in roast | 09:45 | |
just ignore the files in ./coverage and only check t/'s files and it's fine | |||
ThisDoesNotExistAtAll.p6.profraw | |||
lol. | |||
i guess that should maybe be included? but that will require some deciding how to do it | 09:46 | ||
not sure | |||
well they're 535MB | 09:47 | ||
the profile files for all the roast tests XD | |||
they are 416K when processed though | |||
same as they are always. since it doesn't need much more space to record it running some section of code 100000 times compared to 1 time | 09:48 | ||
timotimo | yeah, i don't think it'd make too much sense to upload the raw ones | ||
samcv | since it's all dependent on the size of MVM's codebase | ||
yeah, obv | |||
timotimo | right | ||
samcv | but i may eventually allow you to check coverage of specific roast files. | ||
i mean why not right. go all out | |||
timotimo | these reports should compress really well when you put the same files next to each other in a compressed archive | ||
samcv | gonna try compressing the raw reports :P | 09:51 | |
by default it's default.profraw, and file gets replaced each time it's run. i'm not sure if that actually gets added to the old one or not. but it's better to be able to seperate out the test files | |||
and only merge the ones you know are actually tests, and not like, compiling the compiler | 09:52 | ||
timotimo | do you think it'd be worth trying to have clang on windows? like, we already have that on travis | ||
but what we could try is mingw? but i think it's known to not work, at least for the rest of rakudo? | |||
samcv | idk how much effort is it. it must be a normal thing for appveyor? maybe has a tutorial on it? | ||
well the 500MB raw files compressed to 22MB with XZ compression | 09:53 | ||
not bad. and showed off my cpu :) | |||
since xz can be threaded which is neat | |||
timotimo | oh, neat indeed | 09:54 | |
samcv | we def need better coverage of NativeCall | ||
hopefully we can use this info to add more tests | |||
also not sure diff between cover and executed cry.nu/coverage/roast.html | 09:55 | ||
but i think must have to do with possibilities maybe? compared to just line by line | 09:56 | ||
timotimo | perhaps it's how many functions out of this file were ever entered? | ||
samcv | because some lines can execute different ways? | ||
nah | |||
could be the regions? | |||
timotimo | that'd be path coverage, then | ||
samcv | instead of lines? | ||
yeah that's what i *think* it is | |||
timotimo | you mean if one line has multiple coverable pieces? | ||
samcv | yep | ||
timotimo | like if (foo) { puts("lol") } else { puts("nope") }? | ||
that'd be three individual pieces | |||
samcv | sure why not lol | 09:57 | |
may be easier to see here on nqp tests: cry.nu/coverage/report-libmoar.html | |||
since it shows cover vs live coverage | |||
for functions | 09:58 | ||
timotimo | i'd dig it if we could highlight the path parts after MoarVM/src/ | 10:03 | |
samcv | yeah | 10:06 | |
timotimo | should be easy with sed, but there doesn't seem to be an ansi class for like a bright white | ||
samcv | been thinking about building in in /tmp just so it has a shorter path | ||
it's called bold | |||
timotimo | oh, ok | ||
samcv | ;) | ||
anyway lovely people it's about my bedtime | 10:08 | ||
i think i figured out how to fix this page cry.nu/coverage/report-moar.html | |||
timotimo | why not just throw out the coverage report for the moar binary? | 10:09 | |
samcv | to not be a graveyard of files not in that file. and also make sure i don't miss .h files with code in them. will just process with head/tail and cut the output from the file based coverage report and pass it in | ||
why should we | |||
i'll probably appand it to the end of the other one | |||
but in case there later become more files that are used in that binary it could be useful | 10:10 | ||
or maybe there's a way to combine libmoar and moar.... but idk | |||
jnthn | samcv++ # just glancing the coverage reports, looks pretty great :) | ||
samcv | thanks :) | ||
timotimo | OK | 10:11 | |
10:11
zakharyas joined
10:22
debugsectable6 joined
10:26
debugsectable6 joined
|
|||
samcv | ok updated nqp tests. kinda weird its coverage for .h files | 10:35 | |
cry.nu/coverage/ | |||
err ops. my caching is like. too much caching i think? cause i refresh and i don't see a change | |||
but it is there if i clear cache | |||
timotimo, cry.nu/coverage/coverage/home/sama...ull.h.html | 10:37 | ||
interesting | |||
the inlined stuff shows up by file as well as over the entire everything | 10:38 | ||
timotimo | oooh that's kinda cool | 10:40 | |
samcv | looks like i don't think i have any cache settings in the headers. maybe chrome being weird | 10:43 | |
setting expiry at 30 minutes for that folder anyway though | 10:44 | ||
night all! | 10:47 | ||
damn you chrome. just stubbornly not reloading the page when i hit refresh :( | 10:48 | ||
oh well. should be at least better than before. maybe should set cache age lower. since idc about bandwidth | |||
well it's at 1m now | 10:49 | ||
12:19
lizmat joined
15:12
zakharyas joined
15:20
zakharyas joined
15:42
SourceBaby joined
16:08
spebern joined
16:11
AlexDaniel joined
17:02
jpg51 joined
|
|||
samcv | gonna try out clang/llvm svn just in case llvm-cov has any new awesome changes | 19:16 | |
19:19
lizmat joined
19:37
agentzh joined
|
|||
timotimo | mhm | 19:40 | |
btw: ohai | |||
lizmat | o/ | ||
timotimo | i'm writing a new string parser for json_fast | ||
samcv | hello timotimo | 19:44 | |
again? | 19:45 | ||
gonna be every more faster better? | |||
timotimo | hopefully it'll not explode in its memory usage | ||
wow. | 19:48 | ||
it's "a bit" faster and uses "a bit" less memory | 19:52 | ||
but gives equal results | |||
huh, but things break a little | 19:53 | ||
why is there an escape sequence for / ? | |||
samcv | uhm | 19:57 | |
you can escape any character though right? | |||
timotimo | nope | 19:59 | |
samcv | that's what the rfc says tho | 20:00 | |
" Any character may be escaped" | |||
timotimo | huh? | 20:02 | |
json.org says no, but what is that based on again? | |||
that's the ecma standard | 20:03 | ||
"\h\e\l\l\o" | 20:04 | ||
SyntaxError: Unexpected token h in JSON at position 2 | |||
samcv | i was looking at tools.ietf.org/html/rfc7159 | ||
timotimo | that's one parser | ||
samcv | if you escape every character i will hate you | ||
but. i think it's valid | |||
timotimo | no, i disagree | 20:05 | |
samcv | kk. well defer to your better knowledge | ||
timotimo | it says any character may be escaped with a six-letter sequence | ||
which is the \uAFFE ones | |||
"additionally there are a few two-character escape codes" | |||
you were giving me a little bit of a shock there | |||
samcv | also asked this in perl6dev but best way to find out which argument to perl6 executable is the filename? | ||
timotimo | anyway | ||
samcv | is it almost always the last one? | ||
timotimo | wanna guess how much better JSON::Fast is now? | 20:06 | |
here's the baseline: | |||
samcv | but it's not always the last one. | ||
i'm trying to do coverage for roast | |||
timotimo | 12.58user 0.29system 0:13.04elapsed 98%CPU (0avgtext+0avgdata 991276maxresident)k | ||
^- that's with parsing and then rendering | |||
samcv | compared to what? | 20:07 | |
timotimo | 12.34user 0.27system 0:12.67elapsed 99%CPU (0avgtext+0avgdata 982916maxresident)k | ||
without rendering | |||
that's the baseline i'm comparing to | |||
i.e. what it was on current master | |||
samcv | yay so less. and maybe less ram? | ||
timotimo | um, no | ||
it's bad :P | 20:08 | ||
but, but, but | |||
wanna guess how good it is now? | |||
samcv | uh | ||
nope. go ahead ;) | |||
timotimo | 0.31user 0.01system 0:00.33elapsed 98%CPU (0avgtext+0avgdata 87228maxresident)k | ||
samcv | i don't believe you | ||
fully | |||
timotimo | i didn't believe me, too | ||
i just pushed it, feel free to play around with it | 20:10 | ||
oh crap | |||
what did i do wrong | |||
huh, zef says it fails a whole bunch of tests | 20:11 | ||
but when i run stuff manually it's fine? | |||
and prove also says "all tests successful" | |||
wtf, zef, what am i doing wrong? | 20:13 | ||
20:34
agentzh joined
|
|||
samcv | try uninstalling it first | 20:37 | |
to make sure it's not running the old version | |||
that's installed | |||
ahhhh llvm failed a test at the very end of compling everyyyything | 20:38 | ||
hopefully i can salvage the build | 20:39 | ||
21:03
agentzh joined
|
|||
timotimo | :o | 21:12 | |
21:28
agentzh joined
21:44
agentzh joined
21:56
agentzh joined
22:04
agentzh joined
22:14
agentzh joined
22:27
agentzh joined
23:08
agentzh joined
23:24
lizmat joined
|