What is Streaming?
Streaming is a technique in which the server provides the response to a request in chunks. I can think of a couple of reasons why this might be useful:
Very large responses. Having to assemble a response in memory only to return it to the client can be inefficient for very large responses. An … Read More →
So you need to perform simple Extract Transform Load (ETL) from different databases to a data warehouse to perform some data aggregation for business intelligence. There are alot of ETL products out there which you felt is overkilled for your simple use case.
Here I am going to walk you through on how to Extract data … Read More →
Excel files can be read using the Python module Pandas. In this article we will read excel files using Pandas.
Data Analysis in Python with Pandas
Read Excel column names
We import the pandas module, including ExcelFile. The method read_excel() reads the data into a Pandas Data Frame, where the first parameter is the filename and the … Read More →
We can use Python urllib to get website content in python program.
We can also use it to call REST web services.
We can make GET and POST http requests.
This module allows us to make HTTP as well as HTTPS requests.
We can send request headers and also get information about response headers.
Response read() method returns the … Read More →
Python is strongly typed (i.e. types are enforced), dynamically, implicitly typed (i.e. you don't have to declare variables), case sensitive (i.e. var and VAR are two different variables) and object-oriented (i.e. everything is an object).
Help in Python is always available right in the interpreter. If you want to know how an object works, all … Read More →
What is Twisted?
Twisted is an event-driven networking engine written in Python and licensed under the open source MIT license. Twisted runs on Python 2 and an ever growing subset also works with Python 3.
Here's a simple publish/subscribe server, where clients see all messages posted by other clients:
You can test this out by opening two terminals … Read More →
A failure detector is a key building block for fault-tolerant distributed system, which provide a mechanism to collect information of process failure.
The Heartbeat Model
The heartbeat model is used in most distributed systems. Every process p periodically sends an “I am alive” heartbeat message to the process q. The period is the heartbeat interval Δi.
If q … Read More →