Data Engineering and Big Data


Comments

Post a Comment

Popular posts from this blog

Project: GIS with Folium

Image
A geographic information system (GIS) is a conceptualized framework that provides the ability to capture and analyze spatial and geographic data. GIS applications (or GIS apps) are computer-based tools, that allow the user to create interactive queries (user-created searches), analyze spatial information output, edit data presented within maps, and visually share the results of these operations. Geographic information science (or, GIScience)—the scientific study of geographic concepts, applications, and systems—is commonly initialized as GIS, as well. Geographic information systems are utilized in multiple technologies, processes, techniques, and methods. It is attached to various operations and numerous applications, that relate to engineering, planning, management, transport/logistics, insurance, telecommunications, and business. For this reason, GIS and location intelligence applications are at the foundation of location-enabled services, that rely on geographic ana
Read more

Project: Heartbeat computing

Image
In computer science, a heartbeat is a periodic signal generated by hardware or software to indicate normal operation or to synchronize other parts of a computer system. Usually, a heartbeat is sent between machines at a regular interval in the order of seconds; a heartbeat message. If the endpoint does not receive a heartbeat for a time—usually a few heartbeat intervals—the machine that should have sent the heartbeat is assumed to have failed. Heartbeat messages are typically sent non-stop on a periodic or recurring basis from the originator's start-up until the originator's shutdown. When the destination identifies a lack of heartbeat messages during an anticipated arrival period, the destination may determine that the originator has failed, shutdown, or is generally no longer available. Heartbeat messages may be used for high-availability and fault-tolerance purposes.
Read more

NLI (Natural Language Inferencing)

Image
  "…when you have eliminated the impossible, whatever remains, however improbable, must be the truth"    Sir Arthur Conan Doyle Our brains process the meaning of a sentence like this rather quickly. We're able to surmise: Some things to be true: "You can find the right answer through the process of elimination.” Others that may have the truth: "Ideas that are improbable are not impossible!" And some claims are clearly contradictory: "Things that you have ruled out as impossible are where the truth lies." Natural language processing (NLP) has grown increasingly elaborate over the past few years. Machine learning models tackle question answering, text extraction, sentence generation, and many other complex tasks. But, can machines determine the relationships between sentences, or is that still left to humans? If NLP can be applied between sentences, this could have profound implications for fact-checking, identifying fake news, analyzing text, and m
Read more