SEARCH KEYWORD -- DATA ENGINEERING



  FTP active mode and passive mode

1. What's active mode and passive mode a. FTP has two ports to control: Port 20 is for data transfer Port 21 is for control or establish TCP connection b. The process of active connection Note: C represents Client and S represents Server S opens port 20 and 21 C connects to port 21 of S with a random port, this port can be between 1024 and 65536, it sends port+x to server at the same time to specify C(X)->S(21) When S receives the command, it will sends back ACK, S(21)->C(X) S will set ...

   FTP,Active mode,Passive mode     2013-04-01 07:01:25

  Do scientists really need a PhD?

Young scientists at a Chinese genomics institute are foregoing conventional postgraduate training for the chance to be part of major scientific initiatives. Is this the way of the future?The approach to extended postgraduate training varies from country to country. The United States and Europe, for example, have long believed that students need to finish a multiyear programme of postgraduate work before they can fully participate in the front rank of research, whether in industry or acad...

   Career,PhD,Scientist,Relationship,BGI     2012-01-02 08:19:32

  Unicode over 60 percent of the web

Computers store every piece of text using a “character encoding,” which gives a number to each character. For example, the byte 61 stands for ‘a’ and 62 stands for ‘b’ in the ASCII encoding, which was launched in 1963. Before the web, computer systems were siloed, and there were hundreds of different encodings. Depending on the encoding, C1 could mean any of ¡, Ё, Ä„, Ħ, ‘, ”, or parts of thousands of characters, from æ to å...

   Unicode,Encoding,Website,Percentage,Statustic     2012-02-07 06:19:34

  Is Singapore a good place for startups?

Singapore is long time being considered as a perfect place for living and investing given its beautiful environment, warmly climate,  well-polished legal system and well-known richness. Its government is relatively young and open-minded. They like to take new challenges and embrace new technologies. It's the first country to open its government data to the world online. Many of you may consider that Singapore would be a perfect place for you to start your next startup. But the tr...

   SINGAPORE,STARTUP     2016-03-09 09:06:32

  Pros and cons of 6 most popular test automation frameworks

Not everyone dappling into systems for test automation knows how to leverage the maximum benefit and keep them going in top shape for a long time. That's where test automation frameworks come in – they're basically sets of rules, standards, protocols and guidelines which can be incorporated into practice or simply followed to provide beneficial execution environments for automation test scripts.   Why are test automation frameworks important?   Test automation frameworks offer m...

       2015-11-30 08:14:23

  Chrome overtakes IE as the No.1 browser

According to data from market research company StartCounter, by May 2012, Chrome has overtakes IE as the No. 1 web browser globally. Firefox and Safari is following IE to be 3rd and 4th most popular web browser.In May, market share of Chrome is 33%, while IE only gets 32%. Firefox is slowly dropping, which has a share of 25%.  However, with release date of Windows 8 approaching, IE 10 will also be shipped with Win8, at that time, the number of users who use IE may increase because according...

   Chrome,No.1,IE,StatCounter     2012-05-21 06:03:04

  Use progressive JPEG to improve user experience

JPEG image files can have two different save types : Baseline JPEG and Progressive JPEG. Both of them have the same extension name but with different display effect. Baseline JPEG This type of JPEG files are scanned from top to bottom consecutively, each line of the image data will be saved sequentially. When opening this kind of images, data will be displayed with the save order line by line until all the data are read. If the image size is very large or network speed is very slow, the image wi...

   USER EXPERIENCE,PROGRESSIVE JPEG,BASELINE JPEG     2013-07-25 08:11:50

  A Sip of Go Log

Logging is indispensable in any code that we need its support both in debugging and in statistics. However, a package that filled withfmt.Println/fmt.Printf printing various messages can never be considered a read-to-be-adopted package, which can be optimized by a simple change, using Golang’s native log package to print information to standard output or to a file. Then, how to apply the log package? Are there any limitations? If so, can we seek open-source packages? Let&rsq...

   GOLANG,LOGGING     2022-06-16 05:43:24

  The trap of the performance sweet spot

This post is about JavaScript performance but I would like to start it by telling a story that might seem unrelated to JS. Please bear with me if you don’t like C.A story of a C programmer writing JavaScriptMr. C. is a C programmer as you can probably guess from his name. Today he was asked by his boss to write a very simple function: given an array of numbered 2d points calculate vector sum of all even numbered points... He opens his favorite text editor and quickly types somet...

   C,JavaScript,Sweet spot,Memory,Low level,Trap     2011-11-06 14:45:01

  Using Fabric to deploy web app

Many people may use FTP and rsync to synchronize codes to server, this way is fine but it may be troublesome when you need to deploy many times a day, actually there is a simple way if you can spend time on finding the fast way. We introduce Fabric today for deploying web app to remote server. Fabric is a deployment tool written with Python, the biggest feature if it is you no need to login to remote server, you can execute remote commands locally. Here is s simple deployment script written with...

   Fabric, Web deployment,SSH,Python     2012-12-08 03:16:00