github-fetch-data-repos

fetch info about repos to analyze data later. get stars, language, contributor size

to merge data files run

cat data/data-* > raw_dataset.csv

to remove duplicates run

-u unique
-o output file

sort -u -o uniq.csv raw_dataset.csv

to order them based on stars run

-g general numeric value sort
-r reversed order (desc)
-t separator ","
-k3 by 3th column, starts with k1
-o output file

sort -gr -t , -k3 -o dataset.csv uniq.csv