Image spam

<h2 id="technique">Technique</h2>
The goal of image spam is clearly to circumvent the analysis of the email’s textual content performed by most <a href="/facts/Spam_filter/aKxq5uSf">spam filters</a><a class="footnote-ref" id="fnref:4" href="#fn:4">4</a> (e.g., SpamAssassin, RadicalSpam, Bogofilter, SpamBayes). Accordingly, for the same reason, together with the attached image, often <a href="/facts/Spammers/mkB2Ysdn">spammers</a> add some “bogus” text to the email, namely, a number of words that are most likely to appear in legitimate emails and not in spam.
The earlier image spam emails contained spam images in which the text was clean and easily readable, as shown in Fig. 1.

<h2 id="detection">Detection</h2>
Consequently, <a href="/facts/Optical_character_recognition/kdTyxa1l">optical character recognition</a> tools were used to extract the text embedded into spam images, which could be then processed together with the text in the email’s body by the spam filter, or, more generally, by more sophisticated text categorization techniques.<a class="footnote-ref" id="fnref:5" href="#fn:5">5</a><a class="footnote-ref" id="fnref:6" href="#fn:6">6</a>
Further, signatures (e.g., MD5 hashing) were also generated to easily detected and block already known spam images. 
Spammers in turn reacted by applying some <a href="/facts/Obfuscation/4HXs1ICy">obfuscation</a> techniques to spam images, similarly to <a href="/facts/CAPTCHA/3sIyVjTk">CAPTCHAs</a>, both to prevent the embedded text to be read by OCR tools, and to mislead signature-based detection. Some examples are shown in Fig. 2.
This raised the issue of improving image spam detection using computer vision and pattern recognition techniques.<a class="footnote-ref" id="fnref:7" href="#fn:7">7</a><a class="footnote-ref" id="fnref:8" href="#fn:8">8</a><a class="footnote-ref" id="fnref:9" href="#fn:9">9</a><a class="footnote-ref" id="fnref:10" href="#fn:10">10</a>
In particular, several authors investigated the possibility of recognizing image spam with obfuscated images by using generic low-level image features (like number of colours, prevalent colour coverage, image aspect ratio, text area), image metadata, etc.<a class="footnote-ref" id="fnref:11" href="#fn:11">11</a><a class="footnote-ref" id="fnref:12" href="#fn:12">12</a><a class="footnote-ref" id="fnref:13" href="#fn:13">13</a><a class="footnote-ref" id="fnref:14" href="#fn:14">14</a> (see<a class="footnote-ref" id="fnref:15" href="#fn:15">15</a> for a comprehensive survey).
Notably, some authors also tried detecting the presence of text in attached images with artifacts denoting an adversarial attempt to obfuscate it.<a class="footnote-ref" id="fnref:16" href="#fn:16">16</a><a class="footnote-ref" id="fnref:17" href="#fn:17">17</a><a class="footnote-ref" id="fnref:18" href="#fn:18">18</a><a class="footnote-ref" id="fnref:19" href="#fn:19">19</a>

<h2 id="history">History</h2>
Image spam started in 2004 and peaked at the end of 2006, when over 50% of spam was image spam. In mid-2007, it started declining, and practically disappeared in 2008.<a class="footnote-ref" id="fnref:20" href="#fn:20">20</a> The reason behind this phenomenon is not easy to understand. The decline of image spam can probably be attributed both to the improvement of the proposed countermeasures (e.g., fast image spam detectors based on visual features), and to the higher requirements in terms of bandwidth of image spam that force spammers to send a smaller amount of spam over a given time interval. Both factors might have made image spam less convenient for spammers than other kinds of spam.
Nevertheless, at the end of 2011 a rebirth of image spam was detected, and image spam reached 8% of all spam traffic, albeit for a small period.<a class="footnote-ref" id="fnref:21" href="#fn:21">21</a>

<h2 id="see-also">See also</h2>
<ul><li><a href="/facts/Anti-spam_techniques/WqhhDVXj">Anti-spam techniques</a></li>
<li><a href="/facts/Email_spam/ARJr6Aem">Email spam</a></li></ul>

<h2 id="references">References</h2>

<ol>
<li id="fn:1">Giorgio Fumera, Ignazio Pillai, Fabio Roli,"Spam filtering based on the analysis of text information embedded into images". Journal of Machine Learning Research (special issue on Machine Learning in Computer Security), vol. 7, pp. 2699-2720, 12/2006. <a href="http://jmlr.csail.mit.edu/papers/v7/fumera06a.html" target="_blank">http://jmlr.csail.mit.edu/papers/v7/fumera06a.html</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></li>
<li id="fn:2">Battista Biggio, Giorgio Fumera, Ignazio Pillai, Fabio Roli,Biggio, Battista; Fumera, Giorgio; Pillai, Ignazio; Roli, Fabio (2011). "A survey and experimental evaluation of image spam filtering techniques, Pattern Recognition Letters". Pattern Recognition Letters. 32 (10): 1436–1446. doi:10.1016/j.patrec.2011.03.022. Volume 32, Issue 10, 15 July 2011, Pages 1436-1446, ISSN 0167-8655. <a href="/wiki/Doi_(identifier)" target="_blank">/wiki/Doi_(identifier)</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></li>
<li id="fn:3">Li, Siyuan; Li, Ruiguang; Xu, Yuan; Zhou, Hao; Yan, Hanbing; Xu, Bin; Zhang, Honggang (2018-09-01). "WAF-Based Chinese Character Recognition for Spam Image Filtering". Chinese Journal of Electronics. 27 (5): 1050–1055. doi:10.1049/cje.2018.06.014. ISSN 1022-4653. <a href="https://doi.org/10.1049%2Fcje.2018.06.014" target="_blank">https://doi.org/10.1049%2Fcje.2018.06.014</a> <a href="#fnref:3" class="footnote-back-ref">↩</a></li>
<li id="fn:4">Li, Siyuan; Li, Ruiguang; Xu, Yuan; Zhou, Hao; Yan, Hanbing; Xu, Bin; Zhang, Honggang (2018-09-01). "WAF-Based Chinese Character Recognition for Spam Image Filtering". Chinese Journal of Electronics. 27 (5): 1050–1055. doi:10.1049/cje.2018.06.014. ISSN 1022-4653. <a href="https://doi.org/10.1049%2Fcje.2018.06.014" target="_blank">https://doi.org/10.1049%2Fcje.2018.06.014</a> <a href="#fnref:4" class="footnote-back-ref">↩</a></li>
<li id="fn:5">Giorgio Fumera, Ignazio Pillai, Fabio Roli,"Spam filtering based on the analysis of text information embedded into images". Journal of Machine Learning Research (special issue on Machine Learning in Computer Security), vol. 7, pp. 2699-2720, 12/2006. <a href="http://jmlr.csail.mit.edu/papers/v7/fumera06a.html" target="_blank">http://jmlr.csail.mit.edu/papers/v7/fumera06a.html</a> <a href="#fnref:5" class="footnote-back-ref">↩</a></li>
<li id="fn:6">"Bayes OCR Spam Assassin's Plugin". Archived from the original on 2013-12-07. Retrieved 2013-12-03. <a href="https://web.archive.org/web/20131207012312/http://pralab.diee.unica.it/en/BayesOCR" target="_blank">https://web.archive.org/web/20131207012312/http://pralab.diee.unica.it/en/BayesOCR</a> <a href="#fnref:6" class="footnote-back-ref">↩</a></li>
<li id="fn:7">Giorgio Fumera, Ignazio Pillai, Fabio Roli,"Spam filtering based on the analysis of text information embedded into images". Journal of Machine Learning Research (special issue on Machine Learning in Computer Security), vol. 7, pp. 2699-2720, 12/2006. <a href="http://jmlr.csail.mit.edu/papers/v7/fumera06a.html" target="_blank">http://jmlr.csail.mit.edu/papers/v7/fumera06a.html</a> <a href="#fnref:7" class="footnote-back-ref">↩</a></li>
<li id="fn:8">Battista Biggio, Giorgio Fumera, Ignazio Pillai, Fabio Roli,Biggio, Battista; Fumera, Giorgio; Pillai, Ignazio; Roli, Fabio (2011). "A survey and experimental evaluation of image spam filtering techniques, Pattern Recognition Letters". Pattern Recognition Letters. 32 (10): 1436–1446. doi:10.1016/j.patrec.2011.03.022. Volume 32, Issue 10, 15 July 2011, Pages 1436-1446, ISSN 0167-8655. <a href="/wiki/Doi_(identifier)" target="_blank">/wiki/Doi_(identifier)</a> <a href="#fnref:8" class="footnote-back-ref">↩</a></li>
<li id="fn:9">Aradhye, H., Myers, G., Herson, J. A., 2005. Image analysis for efficient cat egorization of image-based spam e-mail. In: Proc. Int. Conf. on Document Analysis and Recognition, pp. 914–918. <a href="#fnref:9" class="footnote-back-ref">↩</a></li>
<li id="fn:10">Dredze, M., Gevaryahu, R., Elias-Bachrach, A., 2007. Learning fast classifiers for image spam. In: Proc. 4th Conf. on Email and Anti-Spam (CEAS) <a href="#fnref:10" class="footnote-back-ref">↩</a></li>
<li id="fn:11">Aradhye, H., Myers, G., Herson, J. A., 2005. Image analysis for efficient cat egorization of image-based spam e-mail. In: Proc. Int. Conf. on Document Analysis and Recognition, pp. 914–918. <a href="#fnref:11" class="footnote-back-ref">↩</a></li>
<li id="fn:12">Dredze, M., Gevaryahu, R., Elias-Bachrach, A., 2007. Learning fast classifiers for image spam. In: Proc. 4th Conf. on Email and Anti-Spam (CEAS) <a href="#fnref:12" class="footnote-back-ref">↩</a></li>
<li id="fn:13">Wu, C.-T., Cheng, K.-T., Zhu, Q., Wu, Y.-L., 2005. Using visual features for anti-spam filtering. In: Proc. IEEE Int. Conf. on Image Processing, Vol. III.pp. 501–504. <a href="#fnref:13" class="footnote-back-ref">↩</a></li>
<li id="fn:14">Liu, Q., Qin, Z., Cheng, H., Wan, M., 2010. Efficient modeling of spam images. In: Int. Symp. on Intelligent Information Technology and Security Informatics. IEEE Computer Society, pp. 663–666. <a href="#fnref:14" class="footnote-back-ref">↩</a></li>
<li id="fn:15">Battista Biggio, Giorgio Fumera, Ignazio Pillai, Fabio Roli,Biggio, Battista; Fumera, Giorgio; Pillai, Ignazio; Roli, Fabio (2011). "A survey and experimental evaluation of image spam filtering techniques, Pattern Recognition Letters". Pattern Recognition Letters. 32 (10): 1436–1446. doi:10.1016/j.patrec.2011.03.022. Volume 32, Issue 10, 15 July 2011, Pages 1436-1446, ISSN 0167-8655. <a href="/wiki/Doi_(identifier)" target="_blank">/wiki/Doi_(identifier)</a> <a href="#fnref:15" class="footnote-back-ref">↩</a></li>
<li id="fn:16">"Fuzzy - OCR Spam Assassin's Plugin". <a href="https://wiki.apache.org/spamassassin/FuzzyOcrPlugin" target="_blank">https://wiki.apache.org/spamassassin/FuzzyOcrPlugin</a> <a href="#fnref:16" class="footnote-back-ref">↩</a></li>
<li id="fn:17">Battista Biggio, Giorgio Fumera, Ignazio Pillai, Fabio Roli , "Image Spam Filtering Using Visual Information", 14th Int. Conf. on Image Analysis and Processing (ICIAP 2007), Modena, Italy, IEEE Computer Society, pp. 105--110, 10/09/2007. <a href="https://web.archive.org/web/20131212125519/http://pralab.diee.unica.it/en/node/791" target="_blank">https://web.archive.org/web/20131212125519/http://pralab.diee.unica.it/en/node/791</a> <a href="#fnref:17" class="footnote-back-ref">↩</a></li>
<li id="fn:18">Fabio Roli, Battista Biggio, Giorgio Fumera, Ignazio Pillai, Riccardo Satta , "Image Spam Filtering by Detection of Adversarial Obfuscated Text", Workshop on Neural Information Processing Systems (NIPS), Whistler, British Columbia, Canada, 08/12/2007. <a href="#fnref:18" class="footnote-back-ref">↩</a></li>
<li id="fn:19">Battista Biggio, Giorgio Fumera, Ignazio Pillai, Fabio Roli , "Improving Image Spam Filtering Using Image Text Features", Fifth Conference on Email and Anti-Spam (CEAS 2008), Mountain View, CA, USA, 21/08/2008. <a href="#fnref:19" class="footnote-back-ref">↩</a></li>
<li id="fn:20">IBM X-Force® 2010, Mid-Year Trend and Risk Report (August 2010). <a href="#fnref:20" class="footnote-back-ref">↩</a></li>
<li id="fn:21">IBM X-Force® 2012, Mid-Year Trend and Risk Report (September 2012). <a href="#fnref:21" class="footnote-back-ref">↩</a></li>
</ol>

Image spam open-in-new

Image spam