Skip to content

this is my network spider with golang language.in this project,I use the following real examples and the following technology and framework to complete this project.Now let's start.

Notifications You must be signed in to change notification settings

yijiangwen/GolangSpider

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

66 Commits
 
 
 
 
 
 

Repository files navigation

GolangSpider

this is my network spider with golang language.in this project,I use the following real examples and the following technology and framework to complete this project.Now let's start.

this is using to learning the technology with golang,do not use business to earn money....

Using Technology And FrameWork

  1. gjson(https://github.com/tidwall/gjson)
  2. goquery(https://github.com/PuerkitoBio/goquery)
  3. gorm(https://github.com/jinzhu/gorm)
  4. beego orm(https://github.com/astaxie/beego/orm)
  5. beego logs(https://github.com/astaxie/beego/logs)
  6. regexp standard library(https://studygolang.com/pkgdoc)
  7. net/http standard library(https://studygolang.com/pkgdoc)
  8. channel&goroutine(https://gobyexample.com)

Using Examples

  1. 中国票房(http://www.cbooo.cn/) 中国票房
  2. 古诗文(https://www.gushiwen.org) 古诗文
  3. 酷狗音乐(http://www.kugou.com/) 酷狗音乐
  4. 图片网(http://www.bigbigwork.com/) 图片网
  5. 每日英语听力(http://dict.eudic.net/ting) 每日英语听力
  6. github项目(https://github.com/) github项目
  7. 爱奇艺视频(https://www.iqiyi.com/) 爱奇艺视频

Other Thinking Examples

  1. 抖音短视频 抖音短视频
  2. 快手短视频 快手短视频
  3. 喜马拉雅听书 喜马拉雅听书
  4. 知乎 知乎
  5. 虾米音乐 虾米音乐
  6. 网易云音乐 网易云音乐
  7. 拉勾网 拉勾网

Other Reference

  1. command line music downloader.(....)
  2. mybook(.....)
  3. gobyexample(https://gobyexample.com)
  4. https://github.com/GopherCoder/Go-Spider

About

this is my network spider with golang language.in this project,I use the following real examples and the following technology and framework to complete this project.Now let's start.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Go 75.4%
  • HTML 24.6%