{"guid":"aed02b65-9a16-4a42-ac28-2883da680d0a","title":"Deep Learning Blindspots","subtitle":"Tools for Fooling the \"Black Box\"","slug":"34c3-8860-deep_learning_blindspots","link":"https://fahrplan.events.ccc.de/congress/2017/Fahrplan/events/8860.html","description":"In the past decade, machine learning researchers and theorists have created deep learning architectures which seem to learn complex topics with little intervention. Newer research in adversarial learning questions just how much “learning\" these networks are doing. Several theories have arisen regarding neural network “blind spots” which can be exploited to fool the network. For example, by changing a series of pixels which are imperceptible to the human eye, you can render an image recognition model useless. This talk will review the current state of adversarial learning research and showcase some open-source tools to trick the \"black box.\"","original_language":"eng","persons":["Katharine Jarmul"],"view_count":5893,"promoted":false,"date":"2017-12-28T00:00:00.000+01:00","release_date":"2017-12-28T01:00:00.000+01:00","updated_at":"2026-03-09T23:45:09.128+01:00","tags":["34c3","8860","Resilience"],"length":3227,"duration":3227,"thumb_url":"https://static.media.ccc.de/media/congress/2017/8860-hd.jpg","poster_url":"https://static.media.ccc.de/media/congress/2017/8860-hd_preview.jpg","timeline_url":"https://static.media.ccc.de/media/congress/2017/aed02b65-9a16-4a42-ac28-2883da680d0a-timeline.jpg","thumbnails_url":"https://static.media.ccc.de/media/congress/2017/aed02b65-9a16-4a42-ac28-2883da680d0a-thumbnails.vtt","frontend_link":"https://media.ccc.de/v/34c3-8860-deep_learning_blindspots","url":"https://api.media.ccc.de/public/events/aed02b65-9a16-4a42-ac28-2883da680d0a","conference_title":"34C3: TUWAT","conference_url":"https://api.media.ccc.de/public/conferences/34c3","related":[{"event_id":4762,"event_guid":"b036385c-ec1a-44e5-ae48-af703ce9b5d3","weight":124},{"event_id":4763,"event_guid":"2ef3b60f-6e5c-4c23-a145-d263685ec13e","weight":190},{"event_id":4765,"event_guid":"9326038b-f781-4707-b35a-9ef52f98d35a","weight":125},{"event_id":4766,"event_guid":"19b7e5d7-bba7-46da-afbc-f16d43fe395f","weight":124},{"event_id":4767,"event_guid":"f2ca3661-30c8-476e-9d6b-920bb20b21eb","weight":119},{"event_id":4770,"event_guid":"a890dbd3-8859-4788-a72f-ded5c5c08e5f","weight":134},{"event_id":4782,"event_guid":"de1b5916-8052-4a25-bded-25d96a43aff7","weight":117},{"event_id":4784,"event_guid":"65a25dfd-56dd-4e87-a910-334e2dc25a9c","weight":120},{"event_id":4790,"event_guid":"edd02e52-28f8-4f3e-8b17-75cffecb6d7f","weight":150},{"event_id":4791,"event_guid":"8d29d28d-a222-4731-bdfc-fde590385cae","weight":137},{"event_id":4794,"event_guid":"a2887b4a-0c9d-4220-a52f-c65c20ae25d7","weight":156},{"event_id":4800,"event_guid":"a9ebf7e3-abc5-49d9-8efe-316b3bc52902","weight":151},{"event_id":4804,"event_guid":"0cccbcdd-1e5c-4457-883b-6141c04d754c","weight":137},{"event_id":4808,"event_guid":"acab4111-aba7-44f7-b56e-ef805dcacd00","weight":499},{"event_id":4812,"event_guid":"7edaed35-e938-4a13-b21c-aac4bb0ebf94","weight":108},{"event_id":4814,"event_guid":"991aceeb-d25f-4f59-9317-bf438775a215","weight":155},{"event_id":4823,"event_guid":"bf924a39-2860-4e27-8741-b8fa0c010363","weight":163},{"event_id":4826,"event_guid":"16645200-2036-4a3c-a44d-a5ff44ac2991","weight":310},{"event_id":4832,"event_guid":"275f85de-d612-4440-8755-85dee5912f12","weight":169},{"event_id":4833,"event_guid":"e1a60f7b-6a56-4dce-ab3a-c686fa940aa8","weight":109},{"event_id":4840,"event_guid":"21127aeb-fe1f-4506-a3f0-d747e20419a5","weight":127},{"event_id":4850,"event_guid":"949bee69-3be0-4cc8-915b-5f1167141dcc","weight":106},{"event_id":4855,"event_guid":"51b586be-500c-436e-b70c-fc433e65c4be","weight":135},{"event_id":4866,"event_guid":"117a52b4-f675-49dd-aafe-659c07b6bc9c","weight":210},{"event_id":4876,"event_guid":"dec6a7e0-2651-4bb5-8300-977795e901ed","weight":108},{"event_id":4879,"event_guid":"73bcc647-faa3-4c6c-8a48-8d540de454ee","weight":141},{"event_id":4903,"event_guid":"f68f2747-1c57-4531-a574-3ebe77d80135","weight":144},{"event_id":4929,"event_guid":"8e222759-cd6b-403b-8fe1-3517bf7d2802","weight":124}],"recordings":[{"size":null,"length":null,"mime_type":"application/x-subrip","language":"eng","filename":"34c3-8860-eng-deu-spa-Deep_Learning_Blindspots.en.srt","state":"complete","folder":"","high_quality":true,"width":null,"height":null,"updated_at":"2021-02-21T17:46:34.334+01:00","recording_url":"https://cdn.media.ccc.de/congress/2017/34c3-8860-eng-deu-spa-Deep_Learning_Blindspots.en.srt","url":"https://api.media.ccc.de/public/recordings/44545","event_url":"https://api.media.ccc.de/public/events/aed02b65-9a16-4a42-ac28-2883da680d0a","conference_url":"https://api.media.ccc.de/public/conferences/34c3"},{"size":240,"length":3227,"mime_type":"video/mp4","language":"eng","filename":"34c3-8860-eng-Deep_Learning_Blindspots.mp4","state":"new","folder":"h264-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2017-12-28T17:13:31.475+01:00","recording_url":"https://cdn.media.ccc.de/congress/2017/h264-hd/34c3-8860-eng-Deep_Learning_Blindspots.mp4","url":"https://api.media.ccc.de/public/recordings/21056","event_url":"https://api.media.ccc.de/public/events/aed02b65-9a16-4a42-ac28-2883da680d0a","conference_url":"https://api.media.ccc.de/public/conferences/34c3"},{"size":241,"length":3227,"mime_type":"video/mp4","language":"deu","filename":"34c3-8860-deu-Deep_Learning_Blindspots.mp4","state":"new","folder":"h264-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2017-12-28T17:13:42.672+01:00","recording_url":"https://cdn.media.ccc.de/congress/2017/h264-hd/34c3-8860-deu-Deep_Learning_Blindspots.mp4","url":"https://api.media.ccc.de/public/recordings/21057","event_url":"https://api.media.ccc.de/public/events/aed02b65-9a16-4a42-ac28-2883da680d0a","conference_url":"https://api.media.ccc.de/public/conferences/34c3"},{"size":242,"length":3227,"mime_type":"video/mp4","language":"spa","filename":"34c3-8860-spa-Deep_Learning_Blindspots.mp4","state":"new","folder":"h264-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2017-12-28T17:13:53.962+01:00","recording_url":"https://cdn.media.ccc.de/congress/2017/h264-hd/34c3-8860-spa-Deep_Learning_Blindspots.mp4","url":"https://api.media.ccc.de/public/recordings/21058","event_url":"https://api.media.ccc.de/public/events/aed02b65-9a16-4a42-ac28-2883da680d0a","conference_url":"https://api.media.ccc.de/public/conferences/34c3"},{"size":444,"length":3227,"mime_type":"video/mp4","language":"eng-deu-spa","filename":"34c3-8860-eng-deu-spa-Deep_Learning_Blindspots_hd.mp4","state":"new","folder":"h264-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2017-12-28T17:14:10.609+01:00","recording_url":"https://cdn.media.ccc.de/congress/2017/h264-hd/34c3-8860-eng-deu-spa-Deep_Learning_Blindspots_hd.mp4","url":"https://api.media.ccc.de/public/recordings/21059","event_url":"https://api.media.ccc.de/public/events/aed02b65-9a16-4a42-ac28-2883da680d0a","conference_url":"https://api.media.ccc.de/public/conferences/34c3"},{"size":255,"length":3227,"mime_type":"video/mp4","language":"eng-deu-spa","filename":"34c3-8860-eng-deu-spa-Deep_Learning_Blindspots_hd-slides.mp4","state":"new","folder":"slides-h264-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2017-12-28T17:53:10.655+01:00","recording_url":"https://cdn.media.ccc.de/congress/2017/slides-h264-hd/34c3-8860-eng-deu-spa-Deep_Learning_Blindspots_hd-slides.mp4","url":"https://api.media.ccc.de/public/recordings/21092","event_url":"https://api.media.ccc.de/public/events/aed02b65-9a16-4a42-ac28-2883da680d0a","conference_url":"https://api.media.ccc.de/public/conferences/34c3"},{"size":224,"length":3227,"mime_type":"video/mp4","language":"eng-deu-spa","filename":"34c3-8860-eng-deu-spa-Deep_Learning_Blindspots_sd.mp4","state":"new","folder":"h264-sd","high_quality":false,"width":720,"height":576,"updated_at":"2017-12-28T20:46:51.075+01:00","recording_url":"https://cdn.media.ccc.de/congress/2017/h264-sd/34c3-8860-eng-deu-spa-Deep_Learning_Blindspots_sd.mp4","url":"https://api.media.ccc.de/public/recordings/21188","event_url":"https://api.media.ccc.de/public/events/aed02b65-9a16-4a42-ac28-2883da680d0a","conference_url":"https://api.media.ccc.de/public/conferences/34c3"},{"size":31,"length":3212,"mime_type":"audio/opus","language":"eng","filename":"34c3-8860-eng-Deep_Learning_Blindspots.opus","state":"new","folder":"opus","high_quality":false,"width":0,"height":0,"updated_at":"2017-12-28T20:47:36.598+01:00","recording_url":"https://cdn.media.ccc.de/congress/2017/opus/34c3-8860-eng-Deep_Learning_Blindspots.opus","url":"https://api.media.ccc.de/public/recordings/21189","event_url":"https://api.media.ccc.de/public/events/aed02b65-9a16-4a42-ac28-2883da680d0a","conference_url":"https://api.media.ccc.de/public/conferences/34c3"},{"size":49,"length":3212,"mime_type":"audio/mpeg","language":"eng","filename":"34c3-8860-eng-Deep_Learning_Blindspots.mp3","state":"new","folder":"mp3","high_quality":false,"width":0,"height":0,"updated_at":"2017-12-28T20:48:08.067+01:00","recording_url":"https://cdn.media.ccc.de/congress/2017/mp3/34c3-8860-eng-Deep_Learning_Blindspots.mp3","url":"https://api.media.ccc.de/public/recordings/21190","event_url":"https://api.media.ccc.de/public/events/aed02b65-9a16-4a42-ac28-2883da680d0a","conference_url":"https://api.media.ccc.de/public/conferences/34c3"},{"size":422,"length":3227,"mime_type":"video/webm","language":"eng-deu-spa","filename":"34c3-8860-eng-deu-spa-Deep_Learning_Blindspots_webm-sd.webm","state":"new","folder":"webm-sd","high_quality":false,"width":720,"height":576,"updated_at":"2017-12-28T21:01:57.465+01:00","recording_url":"https://cdn.media.ccc.de/congress/2017/webm-sd/34c3-8860-eng-deu-spa-Deep_Learning_Blindspots_webm-sd.webm","url":"https://api.media.ccc.de/public/recordings/21214","event_url":"https://api.media.ccc.de/public/events/aed02b65-9a16-4a42-ac28-2883da680d0a","conference_url":"https://api.media.ccc.de/public/conferences/34c3"},{"size":550,"length":3227,"mime_type":"video/webm","language":"eng-deu-spa","filename":"34c3-8860-eng-deu-spa-Deep_Learning_Blindspots_webm-hd.webm","state":"new","folder":"webm-hd","high_quality":true,"width":1920,"height":1080,"updated_at":"2017-12-29T00:13:28.327+01:00","recording_url":"https://cdn.media.ccc.de/congress/2017/webm-hd/34c3-8860-eng-deu-spa-Deep_Learning_Blindspots_webm-hd.webm","url":"https://api.media.ccc.de/public/recordings/21355","event_url":"https://api.media.ccc.de/public/events/aed02b65-9a16-4a42-ac28-2883da680d0a","conference_url":"https://api.media.ccc.de/public/conferences/34c3"},{"size":66,"length":3227,"mime_type":"video/mp4","language":"eng","filename":"34c3-8860-eng-Deep_Learning_Blindspots_sd-slides.mp4","state":"new","folder":"slides-h264-sd","high_quality":false,"width":720,"height":576,"updated_at":"2018-01-02T15:40:54.962+01:00","recording_url":"https://cdn.media.ccc.de/congress/2017/slides-h264-sd/34c3-8860-eng-Deep_Learning_Blindspots_sd-slides.mp4","url":"https://api.media.ccc.de/public/recordings/22298","event_url":"https://api.media.ccc.de/public/events/aed02b65-9a16-4a42-ac28-2883da680d0a","conference_url":"https://api.media.ccc.de/public/conferences/34c3"}]}