Data stream

<h2 id="formal-definition">Formal definition</h2>
<p>In a formal way, a data stream is any <a href="/facts/Ordered_pair/EInLVI0r">ordered pair</a> 
  
    
      
        (
        s
        ,
        Δ
        )
      
    
    {\displaystyle (s,\Delta )}
  
 where:
</p>
<ol><li>
  
    
      
        s
      
    
    {\displaystyle s}
  
 is a <a href="/facts/Sequence/gV2S4uqp">sequence</a> of <a href="/facts/Tuple/BI1HIxL8">tuples</a> and</li>
<li>
  
    
      
        Δ
      
    
    {\displaystyle \Delta }
  
 is a sequence of positive <a href="/facts/Real_number/R02gw5Pb">real</a> <a href="/facts/Time_interval/6ApueJCc">time intervals</a>.</li></ol>
<h2 id="content">Content</h2>
<p>Data Stream contains different sets of data, that depend on the chosen data format. 
</p>
<ul><li>Attributes – each attribute<a class="footnote-ref" id="fnref:3" href="#fn:3"><sup>3</sup></a> of the data stream represents a certain type of data, e.g. segment / data point ID, timestamp, geodata.</li>
<li><a href="/facts/Timestamp/6lApANE6">Timestamp</a> attribute helps to identify when an event occurred.</li>
<li>Subject ID is an encoded-by-algorithm ID, that has been extracted out of a <a href="/facts/Magic_cookie/ErNSw6wK">cookie</a>.</li>
<li><a href="/facts/Raw_Data/fAVLcq7W">Raw Data</a> includes information straight from the data provider without being processed by an algorithm nor human.</li>
<li>Processed Data is a data that has been prepared<a class="footnote-ref" id="fnref:4" href="#fn:4"><sup>4</sup></a> (somehow modified, validated or cleaned), to be used for future actions.</li></ul>
<h2 id="usage">Usage</h2>
<p>There are various areas where data streams are used:
</p>
<ul><li>Fraud detection & scoring – raw data is used as source data for an anti-fraud algorithm (<a href="/facts/Data_analysis_techniques_for_fraud_detection/P5mE7yxW">data analysis techniques for fraud detection</a>). For example, timestamps, cookie occurrences or analysis of data points are used within the scoring system to detect fraud or to make sure that a message receiver is not a bot (so-called Non-Human Traffic<a class="footnote-ref" id="fnref:5" href="#fn:5"><sup>5</sup></a>).</li>
<li><a href="/facts/Artificial_intelligence/lJGauQwX">Artificial intelligence</a> – raw data is treated like a train set and a test set during AI and <a href="/facts/Machine_learning/e0w0XJTu">machine learning</a> algorithms building.</li>
<li><a href="/facts/Raw_data/fAVLcq7W">Raw data</a> is used for profiling and personalization to customize user profiles<a class="footnote-ref" id="fnref:6" href="#fn:6"><sup>6</sup></a> and divide them for segmentation, e.g., per gender or location (based on <a href="/facts/Data_point/IFEDysRP">data point</a>).</li>
<li><a href="/facts/Business_intelligence/ftThn7Wf">Business intelligence</a> – raw data is a source of information for BI systems, used for enriching user profiles with detailed information about them, e.g., purchase path or geodata. This information is used for <a href="/facts/Business_analysis/yKgTq3Ty">business analysis</a> and predictive research.</li>
<li>Targeting – processed data by data scientists improve online campaigns and is used for reaching the target audience.<a class="footnote-ref" id="fnref:7" href="#fn:7"><sup>7</sup></a></li>
<li>CRM Enrichment – raw data is integrated with <a href="/facts/Customer-relationship_management/Y74q0uXB">customer-relationship management</a> system. CRM integration allows to fill the gaps in users' profiles with demographic data, interests or buying intentions.</li></ul>
<h2 id="integration">Integration</h2>
<p>Core integrations with data streams are:
</p>
<ul><li>Data streams are integrated with systems such as <a href="/facts/Customer_data_platform/lkdFRR2o">customer data platform</a> (CDP), customer relationship management (CRM) or <a href="/facts/Data_management_platform/Wl8Xd05F">data management platform</a> (DMP) to enrich users' profiles with external data. It is possible to expand the knowledge about existing users by using external sources.<a class="footnote-ref" id="fnref:8" href="#fn:8"><sup>8</sup></a></li>
<li>Data streams are used to enrich business intelligence systems and make analysis more precise and conclusions more accurate.</li>
<li>In the case of <a href="/facts/Content_management_system/CCk4vIxV">content management system</a> (CMS) integration, Data Stream is used to identify the users and personalize their visit, even if it's their first one. By data analysis, the actual content of the website is adapted to the user.</li>
<li>Data streams are integrated with <a href="/facts/Demand_side_platform/27kjUYHb">demand side platform</a> (DSP) within programmatic advertising ecosystem. Parties (e.g., advertisers) can exchange the users' IDs and concatenate with them existing profiles.</li>
<li>Data streams are used to choose respective user segments (e.g., people interested in the automotive industry) and use them in an online campaign. Segments are enriched with more user characteristics out of data stream and then sent to DSP.</li></ul>
<h2 id="data-sources-visible">Data sources visible</h2>
<p>In a data stream it is visible what device has been used by the user side – it is visible on <a href="/facts/User_agent/dFEyg2Xj">user agent</a>:
</p>
<ul><li>mobile – when a user uses a mobile browser to explore, it has narrow screen resolution and mobile app version, respectively;</li>
<li>desktop – when a user uses a desktop browser or app version.</li></ul>
<p>The following information is shared out of used device:
</p>
<ul><li>Actual URL to the visited website, where an event occurred</li>
<li>User Agent</li>
<li><a href="/facts/Geolocation/yY41HfWV">Geolocation</a></li>
<li><a href="/facts/Internet_Protocol/Qq6VeEal">Internet Protocol</a> (IP)</li></ul>
<h2 id="formats">Formats</h2>
<p>A <a href="/facts/Data_point/IFEDysRP">data point</a> is a tag that collects information about a certain action, performed by a user on a website. Data points exists in two types, the values of which are used to create appropriate audiences. Those are:
</p>
<ul><li>'event' with information about occurrences of the specific event (e.g., click on a link or displaying ad)</li>
<li>'attribute' with numerical or alphanumerical values.</li></ul>
<p>Segment is a logical statement, built on specific Data Points using AND, OR or NOT operators.<a class="footnote-ref" id="fnref:9" href="#fn:9"><sup>9</sup></a>
Hybrid data – raw data out of both Data Point and Segment data formats.<a class="footnote-ref" id="fnref:10" href="#fn:10"><sup>10</sup></a>
URLs – is a set of information about a particular <a href="/facts/URL/pPD5g7Wq">URL</a> that has been visited. 
</p>
<h2 id="gdpr">GDPR</h2>
<p>Information gathered out of websites are based on user behavior. Data providers deliver both personal or non-personal information. There are two types of user data available in data stream:
</p>
<ul><li><a href="/facts/Personally_identifiable_information/384PbBg5">Personally identifiable information</a> (PII) – information that allows clearly or by combining with data identification methods identify a person. Examples of PII are: insurance ID, email address, phone number, <a href="/facts/IP_address/z9V22Sw9">IP address</a>, geolocation, <a href="/facts/Biometric_data/MgTbyA0r">biometric data</a>.<a class="footnote-ref" id="fnref:11" href="#fn:11"><sup>11</sup></a></li>
<li>Non-personally identifiable information (non-PII) is information that can't be used to identify a person or to track a location. A cookie or a device ID is an example of non-PII.</li></ul>
<h2 id="see-also">See also</h2>
<ul><li><a href="/facts/Streaming_algorithm/BjSCe5rR">Streaming algorithm</a></li></ul>

<h2 id="references">References</h2>

<ol>
<li id="fn:1"><p>"Federal Standard 1037C data stream". Archived from the original on April 13, 2007. Retrieved April 4, 2007. <a href="http://www.its.bldrdoc.gov/fs-1037/dir-010/_1451.htm" target="_blank">http://www.its.bldrdoc.gov/fs-1037/dir-010/_1451.htm</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></p></li>
<li id="fn:2"><p>"Data Stream". techopedia.com. Archived from the original on April 24, 2019. Retrieved April 24, 2019. <a href="https://www.techopedia.com/definition/6757/data-stream" target="_blank">https://www.techopedia.com/definition/6757/data-stream</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></p></li>
<li id="fn:3"><p>"Attribute". businessdictionary.com. Archived from the original on April 24, 2019. Retrieved April 24, 2019. <a href="http://www.businessdictionary.com/definition/attribute.html" target="_blank">http://www.businessdictionary.com/definition/attribute.html</a> <a href="#fnref:3" class="footnote-back-ref">↩</a></p></li>
<li id="fn:4"><p>"What constitutes data processing?". ec.europa.eu. Archived from the original on April 24, 2019. Retrieved April 24, 2019. <a href="https://ec.europa.eu/info/law/law-topic/data-protection/reform/what-constitutes-data-processing_en" target="_blank">https://ec.europa.eu/info/law/law-topic/data-protection/reform/what-constitutes-data-processing_en</a> <a href="#fnref:4" class="footnote-back-ref">↩</a></p></li>
<li id="fn:5"><p>"Non-Human Traffic [NHT]". theonlineadvertisingguide.com. June 7, 2017. Archived from the original on August 13, 2017. Retrieved April 24, 2019. <a href="https://theonlineadvertisingguide.com/glossary/non-human-traffic/" target="_blank">https://theonlineadvertisingguide.com/glossary/non-human-traffic/</a> <a href="#fnref:5" class="footnote-back-ref">↩</a></p></li>
<li id="fn:6"><p>"BEHAVIORAL PROFILING AND PERSONALIZATION: CUSTOMER EXPERIENCE FIRST". selligent.com. July 26, 2012. Archived from the original on April 24, 2019. Retrieved April 24, 2019. <a href="https://www.selligent.com/blog/inspiration/behavioral-profiling-and-personalization-customer-experience-first" target="_blank">https://www.selligent.com/blog/inspiration/behavioral-profiling-and-personalization-customer-experience-first</a> <a href="#fnref:6" class="footnote-back-ref">↩</a></p></li>
<li id="fn:7"><p>"What is Targeting – Meaning". selligent.com. Archived from the original on April 24, 2019. Retrieved April 24, 2019. <a href="https://sendpulse.com/support/glossary/targeting" target="_blank">https://sendpulse.com/support/glossary/targeting</a> <a href="#fnref:7" class="footnote-back-ref">↩</a></p></li>
<li id="fn:8"><p>"What is Data Stream and how to use it". OnAudience.com. April 17, 2019. Archived from the original on April 24, 2019. Retrieved April 24, 2019. <a href="http://www.onaudience.com/resources/what-is-data-stream-and-how-to-use-it/" target="_blank">http://www.onaudience.com/resources/what-is-data-stream-and-how-to-use-it/</a> <a href="#fnref:8" class="footnote-back-ref">↩</a></p></li>
<li id="fn:9"><p>"The 6 types of user segmentation and what they mean for your product". uxdesign.cc. June 12, 2018. <a href="https://uxdesign.cc/how-to-think-segmentation-from-day-1-f714df093ccb" target="_blank">https://uxdesign.cc/how-to-think-segmentation-from-day-1-f714df093ccb</a> <a href="#fnref:9" class="footnote-back-ref">↩</a></p></li>
<li id="fn:10"><p>"What is hybrid data management". ibm.com. January 2, 2018. Archived from the original on April 24, 2019. Retrieved April 24, 2019. <a href="https://www.ibm.com/analytics/data-management/resources/what-is-hybrid-data-management/" target="_blank">https://www.ibm.com/analytics/data-management/resources/what-is-hybrid-data-management/</a> <a href="#fnref:10" class="footnote-back-ref">↩</a></p></li>
<li id="fn:11"><p>"What is personally identifiable information (PII)? How to protect it under GDPR". csoonline.com. Archived from the original on April 24, 2019. Retrieved April 24, 2019. <a href="https://www.csoonline.com/article/3215864/how-to-protect-personally-identifiable-information-pii-under-gdpr.html" target="_blank">https://www.csoonline.com/article/3215864/how-to-protect-personally-identifiable-information-pii-under-gdpr.html</a> <a href="#fnref:11" class="footnote-back-ref">↩</a></p></li>
</ol>

Data stream open-in-new

Data stream