HOME / LATEST NEWS / Content

Club Activity: Python Learning

July 3, 2020

The Girl's Programming Club is a club that allows girls who like programming to learn and communicate together with student-oriented activities. This semester, with the help of their instructor, Mr. He, they’ve learned knowledge about web crawling through Python online, and all club members benefited a lot.

Python is a very flexible, convenient, and easy-to-learn advanced programming language with many modules, libraries, and packages. Web crawlers are programs that help programmers crawl all kinds of information on the Internet and can be used to collect and analyze data. This semester, the students learned to crawl through images, reviews, and rankings, and download videos from major video sites through Python. In addition, they have also created word clouds with Python and web crawling, which can effectively analyze data while also create brilliant visuals.

图片

In the first half of the semester, the members learned how to crawl images from websites through Python, including downloading multiple images from multiple pages, such as wallpapers; downloading multiple images from single pages, such as forums; and downloading single images from multiple pages, such as online reading materials.

图片

图片

图片

Crawling wallpapers from Bing Wallpaper

In the second half of the semester, the members learned how to crawl texts from websites; to download book reviews, film reviews, book and movie charts and other data; and to export them to txt and xlsx (excel) format. The students also tried to automatically count the frequency of words that appear in a text and make a word cloud of it.

Word cloud showing the frequency of words that appear in Hamlet

At the end of the semester, members of the club also learned how to download videos from major video sites in mp4 format using the you-get library from Python.

The students have learned a lot of interesting content in the club this semester. Club members all enjoyed participating in the club activities and learning new knowledge with each other together. If you are interested in programming, take part in various club activities in the next semester!

(Written by Zhongling Guo and Yingxuan Zhu Pictures by Zhongling Guo and Yingxuan Zhu Supervised by Tianzhou He)