Scrapy Web Development

Avoiding getting banned crawling web

  • rotate your user agent from a pool of well-known ones from browsers (google around to get a list of them)
  • disable cookies as some sites may use cookies to spot bot behaviour
  • use download delays (2 or higher).
  • if possible, use Google cache to fetch pages, instead of hitting the sites directly
  • use a pool of rotating IPs. For example, the free Tor project or paid services like ProxyMesh. An open source alternative is scrapoxy, a super proxy that you can attach your own proxies to.
  • use a highly distributed downloader that circumvents bans internally, so you can just focus on parsing clean pages.

In this section we implement the login interface for Larabbs small programs


In the third tutorial, we’ve added the interface for mobile registration and WeChat login, so Larabbs can use:
Cell phone
WeChat Login Sign in in in three ways.

As mentioned in the previous section, if the public platform is bound to other WeChat applications and small programs, then UnionId can be used to get the only WeChat user, but because we do not have a real WeChat mobile phone app or web application, so do not discuss.

The scenario for a small program to log on is:
Failure to find a user who is bound by the openid of the eprogram jumps to the login page, asks the user to enter the user name (mailbox or phone) and password, and then binds the user to the e-program openid, returning to access-token, and the login is successful. You can find the bound user based on the openid of the esmalle, return directly to access-token, and log on successfully.


laravel sms api

Configure Content

Non-template channels that can be customized via config/ibrand/sms.php ‘content’ and ‘you signature Dear user, your verification code is %s. Valid for %s minutes, please verify as soon as possible.


In real-world development there is a situation where a verification code is not actually issued, so in debug mode, you can

http://your.domain/api/sms/info?mobile=1898888XXXX to look directly at the current valid verification code information for a cell phone number.
database log

Support is now being supported for saving the send record to the database and performing the php artisan migrate to generate the laravel?sms-log table. Set dblog to true at config/ibrand/sms.php at the same time


Laravel easy sms

Extended development based on business requirements in overtrue/easy-sms, primarily for the following:
Support sMS verification codes to configure template Ids directly in config
Support sMS verification code customization length
Support for SMS verification code valid minutes, default 5 minutes
Support sMS verification code retry times to prevent users from accidentally mis-sending verification code caused by the need to send the verification code again
When the support SMS verification code is not verified, the user requests the verification code again, which is consistent within a valid minute
Integrated SMS sending routing to support web and api delivery methods
Support for verification code debugging, debug mode can directly query the mobile phone number is currently valid verification code, debug mode will not verify the correctness of the verification code Supports verification codes to send records to the database for easy viewing of send logs and error causes


WordPress post link not found

One of the most common phenomena is that the initial fixed link is not set up and the fixed link needs to be re-modified to allow the article to be accessed. No additional action is required.    Many cloud platforms are problematic at the beginning of the setup and need to reset the fixed link when using it. Modify method: Select your fixed link structure. In the settings → fixed link, you can select the default format, or you can use the structure label to enter the format you want in the input box of the custom structure. So that each address corresponds to a unique blog. For performance reasons, it is not recommended to use blog types, blog tags, bloggers, blog titles as the beginning of fixed link addresses, which are plain Text properties (field), using them as the beginning of the link, WordPress needs more time to distinguish between article addresses and pages (page) Address, and in order to distinguish between additional information to be stored in the database, it slows down the opening of the article. If you are just using WordPress and there is a phenomenon that the article cannot access, it is most likely because there is a problem with WordPress’s fixed link.


WordPress free plugin guide

Whether you’re a developer who likes code or a designer who wants to make high-quality sites easily, you’ll need the help of a WordPress plugin at some point. Sometimes, when you need to add a pop-up window or animation effect, it’s not worth trying to implement it manually. There are already so many good plug-ins, others have done what you need for you, so why waste time making wheels over and over again from scratch? Admittedly, the cost issue is also a factor that cannot be bypassed. But not all high-quality, easy-to-use plug-ins cost money to be used. In fact, many high-score and commonly used plug-ins are free. In a way, the free WordPress plugin is as good as the premium paid plugin, … Well, the words can’t be said to be dead. So, how do you know if a free plugin is trustworthy? Is the free plugin better than the paid version? Which free plug-ins are actually needed and won’t slow down the WordPress site? The reviews in this article will cover these considerations when choosing a free WordPress plugin.

App Design Wordpress

What is wordpress?

WordPress is the most widely used blogging system in the world. Its powerful open source community has driven its booming. WordPress because of the large number of users, so the community is very active, there is a wealth of plug-in template resources and communication platform. So we will have a lot of strong help in the process of learning and using, there is no need to worry about problems can not solve the predicament.

WordPress was originally a personal blogging system, and later evolved into a content management system software, which was developed using the PHP language and MySQL database. This means that we can build a variety of websites with WordPress. Users can also use their own blogs on servers that support PHP and MySQL databases (critical). Of course, some small partners are thinking, I did not learn PHP and MySQL to do not matter? In fact, WordPress use is as simple as Weibo and friends Circle, in which the use of PHP and MySQL content is also very few. People don’t have to worry about it at all. WordPress official support for the Chinese version. The original version of WordPress was in English, using the utf-8 code (now also OH), from December 23, 2014 released with version 4.1 (see WordPress official website). Of course, WordPress officials also support the Chinese version, while there are third-party language packs developed by enthusiasts, such as Wopus Chinese language packs. WordPress has thousands of plug-ins and countless theme template styles.

Starting from 3.0, WordPress has built-in multi-user blog features that allow you to open a blog platform that supports multiple domains with simple settings.


Efficient, Creative & High Performance WordPress News & Community Theme

Custom WordPress development

WordPress is the world’s most popular content management system. WordPress powers 33.0% of all the websites on the Internet. WordPress is one of the most popular ways to build a website. WordPress has Beautiful designs, powerful features, and the freedom to build anything you want.