- Published on
A native Rust robots.txt parser
- Authors
- Name
- Hao Chen
- @haoel
Content
https://github.com/Folyd/robotstxt
我用rust重写了Google的robots.txt解析器，并且用rust代码跑通了Google的C++测试用例，欢迎大家star🥰
Link Preview
- https://github.com/Folyd/robotstxt
- A native Rust port of Google's robots.txt parser and matcher C++ library.