如何搜索按提交次数排序的 github 个项目？

Question

我正在考虑试用 BigQuery 和 GithubArchive，但我不确定如何编写一个查询让我在代码或项目中搜索术语并按提交数量降序排列结果。

感谢任何提示

Answer 1

加载到 BigQuery 的 GithubArchive 数据没有源代码副本，因此无法在代码中搜索词条。但是如果你想在存储库描述中搜索一个术语，然后根据提交次数选择顶级存储库，这里是一个如何做到这一点的例子（这个例子中的术语是 "SQL"）：

select count(*) c, repository_url, repository_description
from [githubarchive:github.timeline]
where type = 'PushEvent' and repository_description contains 'SQL'
group by 2, 3
order by c desc
limit 10

这导致

14925   https://github.com/danberindei/infinispan   Infinispan is an open source data grid platform and highly scalable NoSQL cloud data store.  
9377    https://github.com/postgres/postgres    Mirror of the official PostgreSQL GIT repository. Note that this is just a *mirror* - we don't work with pull requests on github. To contribute, please see http://wiki.postgresql.org/wiki/Submitting_a_Patch   
4876    https://github.com/galderz/infinispan   Infinispan is an open source data grid platform and highly scalable NoSQL cloud data store.  
4747    https://github.com/triAGENS/ArangoDB    ArangoDB is a multi-purpose, open-source database with flexible data models for documents, graphs, and key-values. Build high performance applications using a convenient SQL-like query language or JavaScript/Ruby extensions. Use ACID transaction if you require them. Scale horizontally and vertically with a few mouse clicks.    
3590    https://github.com/webnotes/erpnext Open Source, web-based ERP based on Python, Javascript and MySQL.    
3489    https://github.com/anistor/infinispan   Infinispan is an open source data grid platform and highly scalable NoSQL cloud data store.  
3263    https://github.com/youtube/vitess   vitess provides servers and tools which facilitate scaling of MySQL databases for large scale web services.  
3071    https://github.com/infinispan/infinispan    Infinispan is an open source data grid platform and highly scalable NoSQL cloud data store.  
2631    https://github.com/theory/sqitch    Simple SQL change management     
2358    https://github.com/zzzeek/sqlalchemy    Mirror of SQLAlchemy

Answer 2

SELECT COUNT(1) c, repository_url, repository_description
FROM [githubarchive:github.timeline]
WHERE type = 'PushEvent' 
AND REGEXP_MATCH(repository_description, r'(?i)SQL')
GROUP BY 2, 3
ORDER BY c DESC
LIMIT 10

BigQuery 支持正则表达式，因此您可以灵活地使用搜索模式与搜索词，从而大大改进/缩小搜索结果

以下参考资料可以进一步帮助您：

BigQuery Regular expression functions
re2 Syntax

如何搜索按提交次数排序的 github 个项目？

How to search github projects ordered by number of commits?

git-commit

google-bigquery

github-archive