How to debug?

[bortzmeyer]

The steps in the documentation work fine:

% speed_shoot  /var/log/apache2/access.log* > data.js
parsing:
 /var/log/apache2/access.log
-/var/log/apache2/access.log.1
-/var/log/apache2/access.log.10.gz
-/var/log/apache2/access.log.11.gz
-/var/log/apache2/access.log.12.gz
-/var/log/apache2/access.log.13.gz
-/var/log/apache2/access.log.14.gz
-/var/log/apache2/access.log.2.gz
-/var/log/apache2/access.log.3.gz
-/var/log/apache2/access.log.4.gz
-/var/log/apache2/access.log.5.gz
-/var/log/apache2/access.log.6.gz
-/var/log/apache2/access.log.7.gz
-/var/log/apache2/access.log.8.gz
-/var/log/apache2/access.log.9.gz


477607 lines parsed

%  yahi_all_in_one_maker data.js

%

But when loading the Web page, I get only the menus ("Type of presentation: histograms time series…." "Top requests by status") but otherwise it is empty. No error messages in the HTTP server log. What are the options to debug?

[jul]

first of all,

jq data.js

if the js file is not empty, it does not make sense (the web page is built from the js content)

Then

speed_shoot  -d rejected <   /var/log/apache2/access.log 1> /dev/null

(me don't remember why, but that's how the diagnosis work by taking from stdin (fill myself a ticket))

This should tell why the matching was rejected. It is normally a problem of regexp.

I have no problem giving a hand on this, I use to be a Perl coder.

If you can replace IP by 127.0.0.1/url with non personal/sensitive stuff (RGPD/common sense stuff) for two or three lines (nothing more needed) I would like to have a look at your log to check.

[jul]

jq is not needed, you just need to make sure the data.js file is not empty

[jul]

I added in yahi==0.2.10 in the output the numbers of lines matched at the end of the parsing.

I have a strong suspicion the log format is not apache log combined.

[bortzmeyer]

I added in yahi==0.2.10 in the output the numbers of lines matched at the end of the parsing.

474908 lines parsed
0 lines matched

I have a strong suspicion the log format is not apache log combined.

CustomLog (very close from the combined one). I do not find in the documentation how to indicate my own regexp?

[jul]

Pasting anonymized log lines may be tedious but if you can, with 5 - 10 lines, it should be enough for me to make an educated guess.

Another solution is to paste me the LogFormat and CustomLog (https://httpd.apache.org/docs/2.4/fr/mod/mod_log_config.html) directives from your apache configuration and I should be able to make a regexp and a nice addendum in the documentation on how to build a custom apache log parsers from a working example of yours.

Killing 3 birds with a stone : improving my doc, solving your lack of, and having you obtain a 100% match :D