Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Miw is freezing on a simple case #5

Open
BestPig opened this issue Apr 11, 2017 · 1 comment
Open

Miw is freezing on a simple case #5

BestPig opened this issue Apr 11, 2017 · 1 comment
Assignees

Comments

@BestPig
Copy link
Contributor

BestPig commented Apr 11, 2017

My goal is to count per user, the average of the second value

Here is my exemple of log file I used sample.log

user 1000
user 500
{
    "format_name":"test",
    "delims":" \"",
    "quotechar":"",
    "fields":[
        {
            "name":"user",
            "pos":0,
            "type":"string",
            "key": true
        },
        {
            "name":"rbytes",
            "pos":1,
            "type":"int",
            "aggregated":true,
            "aggregation":"mean"
        }
    ]
}

The command I run

miw -fnames sample.log -ofname test.csv -format_name ../formats/test -output_format csv
files=./data/one.log
I0411 16:30:39.882609  4253 job.cc:122] files size=1
I0411 16:30:39.882654  4253 job.cc:127] Processing file=sample.log

miw seems frozen, it should be a quick computing

@beniz
Copy link
Contributor

beniz commented Apr 11, 2017

Final mean value is now reported instead of numerator and denominator separated. As for the freezing, with fewer lines than cores, you need to use -map_tasks 1, otherwise the leftover cores do freeze... Definitely a bug, but not critical since having more logs than cores is more common than the opposite!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants