DOI: March 2006
Quick-LinksStarter
HandbookFor The
Open SourceAnalyst
Table Of Contents
Foreword6
I NEED YOUR HELP7
911 Final Report8
Acquisition 8
Agriculture8
Area Codes8
Aviation 8
Banking & Finance9
Blogs 9
Bridges9
Center for Army Lessons Learned (CALL) 9
CAMS Around the World9
Chemical/Biological/Radiological10
China10
Country Links 10
Crime & Justice11
Cryptome (controversial site but has good information)11
Cultural Intelligence11
Cyber & Information Warfare 12
Databases (Some Searchable) 12
Defense 13
Demographics & Religion 13
Denial & Deception 14
Department of Homeland Security 14
Department of The Treasury 14
Directories of the World 14
Domain Name Servers 15
Drugs and Terrorism 15
Drug War 15
E-Mail Lookups 15
Embassies of the World 16
Energy 16
Experts On Demand 16
Foreign Broadcast Information Service (now known as the OpenSourceCenter) 17
Federal Government 17
Gangs 18
Global Threats 18
Google 18
Homeland Security 19
Human Trafficking 19
Image, Audio, VideoFinder 19
Improvised Explosive Devices 20
Intelligence 20
International Intelligence Agencies 20
Internet Privacy and Security 20
Iranian Military 21
Iraq 21
Islamic Web Sites 21
Library Resources 21
Liquified Natural Gas Facilities 22
Logistics 22
Mapping and Related Material 22
Medical Intelligence 23
Military Operations in Urban Terrain (MOUT) 23
Missile Threat 23
Muslim Brotherhood 23
National/International Most Wanted WEB Sites 24
Newspapers Around The World 24
North Korean Military 24
Nuclear Reactors and Storage 24
Nuclear Terrorism 25
Oil 25
Online Links 25
Organized Crime 26
Ports Worldwide 26
Propaganda (anti-U.S.). You may feel discomfort reading some articles. 26
Public Data On Sex Offenders 26
Rail26
References 27
Satellite and Space Views (real time) 27
Search Engine Report and Search Engines 27
Secret Armies 27
Secure Email 27
Shopping Malls 28
Steganography and Terrorists 28
Terrorism 28
Terrorist Targets 29
Terrorist Websites 29
Tracerouting 30
Translations Online 30
Transportation 30
Tunnels 30
Water Conflict 30
Weapons Around The Globe 31
Weapons of Mass Destruction 31
Weather 31
World News Network Sitemap (make this your first stop) 32
A Research Guide For Students 32
Open Source Intelligence Cycle Idea 33
This is a starter handbook for your use. It is not complete by any stretch of the imagination and is intended to help you get started building your own handbook. You can add and delete as you wish. The idea is to get you started on something you can continue to build on and share with others. Hopefully at some future date all can be brought together for the benefit of all who use this handbook.
FOREWORD
How many times have you selected your favorite search engine and typed in a search parameter only to have 50,000 or more hits? What to do? Obviously you cannot read each hit, and trying to make sense of the boolean logic and other advanced search techniques just doesn’t seem to produce results in this fast paced intelligence environment where quality rather than quantity is the target. Not an easy task. For this reason I have put together what I would like to think is an answer to your dilemma.
This guide tries to keep you on track and away from the surfing we generally end up doing. Very easy to get distracted when doing a search and curious/eye-catching links take us away from our primary objective. Before you know it, you are in South America, Israel, Belarus or some other exotic place and you forget what you started out to do. As you know, borders do not exist on the internet and you can wind up anywhere if you’re not careful.
This guide contains links to get you the information you require in as short a time as possible and is especially helpful to the MI soldier. The intent is to keep you as focused as possible. This is not to say that search engines are no longer needed, they are indeed. But maybe, just maybe, this guide will help you conduct searches without the distractions.
I also would like to point out that everything in this handout is available to anybody anywhere. Thisincludes criminals and terrorists. But while they may use it for illegal activities we can use it to counter those activities.
Serious peoplemine the WEB, others surf.
The following is taken from the Joint Military Intelligence Training Center that sponsors open source training. The handout is titled Open Source Exploitation: A Guide for Intelligence Analysts.
Recently, the total quantity of data available on the Internet was estimated to be 7,500 terabytes total, withonly 25 to 50 terabytes indexed by search engines (one terabyte = 1,000 gigabytes).While that may seemto be a tremendous amount of data, the United States Library of Congress has more than 100 million publicationsin its collection, or roughly 100 terabytes of textual information.So, while data on the Internetcan be searched quickly, it represents only one of many forms of open source information.
It is also important to understand the volatility of Internet data. A 2000 University of California at Berkeleystudy estimated the average life of an Internet document was 44 days.Whole Internet sites appear and disappearfrequently and without notice. For the open source analyst, this means that any attempts to catalogInternet sites will be difficult and require continuous maintenance to stay current. In short, it may not beenough to simply bookmark Web resources in a browser. Effective open source exploitation may requireactual archiving of Internet sites.
The first mistake one makes when doing research is to just insert words into the search engine without really having a plan for what is needed.
What is your objective? That is, what exactly are you researching? Once you have determined this, then you must take the time to write down key words and not hit the search engine until you are satisfied with your listing. I know it’s hard to do this, but you must take the time, or else you’ll be searching longer than required. If you haven’t found what you’re looking for within the first 20 minutes, then you haven’t mapped out a strategy. However, if after mapping out a strategy you still haven’t found what you’re looking for,then the local library or university should be your next option. Remember, there are vast amounts of information still to be digitized and sad to say only about 20% exists on the Web. Now is the time to visit the subject matter experts in the library. These individuals (librarians) are extremely intelligent and know where to find the information you’re looking for. If they don’t know, they probably know someone who does.
While I have tried to get you to your objective as quickly as possible, there is still no substitute for effective searching techniques. I strongly recommend looking over this very basic WEB searching techniques site and download the tutorial with powerpoint slides and handouts. I think you’ll be impressed with it and it doesn’t take long to complete.
There are two areas one cannot get away from on the WEB, pornography and political agendas. I have definitely made sure that none of the links end up with the former, but the latter cannot be avoided.
WEB Favorites
NOTE: Links with osis.gov require password access to the open source information system. Personnel will not have any problems if they are on a .mil server and have an AKO account. However, there will be occasions when you may not have access to a .mil server because of maintenance or other problems.
911 Final Report
911 Commission Final Report
Acquisition
DefenseAcquisitionUniversity
Office Of Naval Research
Office Of The Under Secretary Of Defense
Defense Procurement And Acquisition Policy
DoD Acquisition Information
Agriculture
Agricultural Terrorism
Economic Research Service
Economic Research Service
Economic Research Service
Area/International Codes
Area Code Listing by Number
All Area Codes
Canadian Code Availability
Geographic Areas
U.S. Area Codes and Time Zones
Area Codes Map
International Dialing Codes
Aviation
Airport directory, flight planning, weather
US military bases (Air Force Bases, Navy Bases, Marines Bases, Coast Guard Air Stations and
Army Air Fields) all over the world.
Airport Search
Airport Information
Airport hotels, limo, quick aids
Flight planning & aviation weather
Air traffic publications library
Aviation crime prevention
Aviation weather at BASEOPS
Defense Internet NOTAM Service
Regulatory Support Division
NationalAviationSafetyDataAnalysisCenter
Interagency Airspace Coordination
National Air Traffic Controllers Association
National Transportation Safety Board
U.S. Military Aviation
World Aeronautical Database
Airports Quick Aid
Airports Serving Mexican Border Region
Pilot Getaways
FAA Notices To Airmen
Airport Taxi Diagrams
Banking & Finance
Banking & Financial Crimes
Financial Crimes Enforcement Network
Financial Scandals
Countering Financial Crime Risks in Information Security
Money Laundering and Financial Crimes
Money Laundering, Terrorism and Financial Institutions
Money Laundering
Transnational Threats
United States Secret Service
BLOGS
Fresh brewed news plus stewing views
Global Politics, Economics & Ideas
Bridges
Top ten links to bridges
Bridges of the world
Famous bridges of the world
Bridge technology
Steel bridges in the world
Bridges in 3D
Bridges in the United States
Timber bridges in the U.S.
Center for Army Lessons Learned (CALL)
CALL
CAMS Around the World
Live weather images
Worldwide WEB Cams
ABC7 WEBCam
US/Worldwide Airport WEB Cams
EarthCam
CAMSCAPE
WEBCAM Directory
Railroad Cams
WEB Cam Directories
Chemical/Biological/Radiological
Chemical and Biological Defense
GLADBAD – A searchable database of databases
Chemical Stockpile Emergency Preparedness Plan
Emergency Preparedness and Response
Biological and Chemical Terrorism
Bioterrorism
Chemical Terrorism
Chemical Agents
Responding to Chemical Terrorism
Chemical and Biological Weapons Resource Page
The most dangerous U.S. chemical facilities
Biological Agents
Radiological Materials and Nuclear Weapons
China
Maps of China
The China Post News
Country Links (link this to the drive where you stored the country files
provided to you)
Lonely Planet Guide
About Countries
Country Facts
World Facts
International Crisis Group
Country Profiles
World Of Facts
Ethnologue: Languages Of The World
Crime & Justice
International Justice Statistics
Criminal Justice Resources
National Alliance of Gang Investigators Associations
Mara Salvatrucha Street Gang (Al Queda's Friends)
Crime and Justice
National Statistics
National Criminal Justice Reference Service
Open Directory for Crime & Justice
True Crime & Justice
Bureau of Justice Statistics
Center for Crime & Justice Studies
Crime Spider
Crime and Criminal Justice Web Links
Missing Children WEB Sites
Interpol
Cryptome (controversial site but has good information)
Eyeball Series
Cultural Intelligence
A Defence of Cultural Intelligence
Cultural Awareness
A Guide to Working with People from Other Cultures
Cultural Intelligence
Cultural Intelligence and Modern Management
Avoiding a Napoleonic Ulcer:Bridging the Gap of CulturalIntelligence (Or,Have WeFocused on
the WrongTransformation?)
Culture and Technologies of Control
University of Military Intelligence
Religion and Beliefs
Cultural Studies
Iraqi Culture Smart Card (printable version)
(printable versions)
Small Wars Journal (material on cultural intelligence)
Pew Global Attitudes Project (a series of worldwide public opinion surveys)
Multicultural
Cyber & Information Warfare
CERTCoordinationCenter
Information Operations
Information Operations URLography
Information Warfare and Information Security on the WEB
Institute for the Advanced Study of Information Warfare
iIfowar: Term Contexts For 'weapon'
The Information Warfare Site
Ms. Guidance: Cyber War
Cyber Warfare and Information Security
The Security Portal for Information System Security Professionals
Georgetown Essays on Information Warfare
Books on subject
Databases(Some Searchable)
World Basic Information Library
Digital National Security Archive
ProQuest
American Religion Data Archive
Army Libraries Directory
CountryWatch
Early Bird
Databases
Databases and Electronic Resources
Databases in Military Science
EBSCO Support
Britannica Online
Federal Government Resources on the WEB
Google’s Uncle Sam
Government Search
Libraries on the WEB
FirstGov
Jane’s Online Research
The Educator’s Reference Desk
Pro Fusion
RootsWeb
Government Databases
Government Printing Office
Search Systems
U.S. National Archjives and Records Administration
National Inventory of Dams
Navigating the Military Internet
Naval War College Library
Pentagon Library
UNBISNET
Periscope
Reference Desk
Organized Crime and CorruptionBibliographic Database Search
DOD and Military Electronic Journals
The Wednesday Report - Canada's Aerospace and Defence Weekly
Direct Search
The Invisible WEB
Complete Planet
U.S. Federal Government Agencies Database
The Academic Web Link Database Project
Patent Searching
Databases On The World Wide WEB
Federal Bulletin Board GPO Access
GPO Access Online
Google Scholar
Cold War Black Projects
Find Databases
Those Dark Hiding Places
Georgetown University Library
Defense
Air Force Research Link
Airport Search
Association of the United States Army (AUSA)
CENTCOM
Center for Defense Information
DefenseTechnicalInformationCenter
Defense Link
Defense News
DoD Almanac
Military Resources
Global Security
Military Equipment
Lessons Learned
Coast Guard
Demographics & Religion
Religion by Location and Name
Religions of the World
U.S. Census Bureau
American Religion Data Archive
Hartford Institute for Religion Research
Western Religions
Religion Links
Major World Religions
A Comparative Analysis of The Major World Religions
The Religion of The Taliban
Holy Qur'an Resources on the Internet
A Brief Guide to Understanding Islam
Salam Iran
Understanding Islam and Muslims
Denial and Deception
Background Briefing on Enemy Denial and Deception
Denial and Deception Strategy
The Security Situation in the Taiwan Strait
Department of Homeland Security
Vehicle Guideleine
Surveillance Truck
Department of The Treasury
Specially Designated Nationals and Blocked Persons
Directories of the World
Webmaster World
Infobel
International White and Yellow Pages
Iran Online Yellow Pages
Links to the World Directories
NumberWay
The Global Yellow Pages
World Business Directories
Worldwide Yellow Pages
Domain Name Servers
All Domains
WHOIS Database Search
Host Name to IP Address
Internet Query Tools
DNS Lookup
DNS Stuff
Search and Register Domain Names
Domain Name Search
Domain Surfer
Domainator
Geektools
InterNic
Multiple DNS Lookup
Webserver Search
Query the APNIC Whois Database
RIPE Whois Search
Check Domain
Super DNS Lookup
Network Administrators Guide
Query Tools
Internet Tools
Drugs and Terrorism
Drugs and Terrorism: A New Perspective (dated but useful)
How Drug Prohibition Finances and Otherwise Enables Terrorism
How the Drug War in Afghanistan Undermines America’s War on Terror
The Links Between Drug Prohibition and Terrorism
Useful Sites
Afghanistan Drugs and Terrorism
Crime, Drug Prohibition and Terrorism: An Inevitable Convergence
Mini Submarine
Drug War
Common Sense for Drug Policy
The Real Drug Lords
Drug Cartels and Other Organized Crime Groups
Mexico Fights US Drug War
The Globalization Of The Drug Trade
E-Mail Lookups
411 Locate
AnyWho
Search Detective
InfoSpace
Email Address Links
Reverse Lookup and Email Search
MetaEmailSearchAgent
PeopleSearchNet
The Ultimate Email Directory
World Email
Embassies of the World
Directory of Arab embassies and consulates in London
World Embassy Database
Embassy of the Republic of Armenia
Websites of U.S. Embassies and Consulates
Turkish Embassies in America and World
Index of Foreign Embassies in Australia
Embassy Search
Embassies of the World
EmbassyWorld
Embassies and Consulates
Foreign Embassies of Washington, D.C.
Chiefs of State and Cabinet Members of Foreign Governments
Foreign Governments
Energy
Global Energy Network Institute
Center for Global Energy Studies
Energy Central
Energy Intelligence
Electric Power Research Institute
Energy Market Maps
California On-Line Energy Maps
Department of Nuclear Energy
Databases and Directories
Renewable Energy Projects
The Coming Global Energy Crisis
U.S. Department of Energy
World Energy Council
Energy Review
Experts On Demand
Foreign Broadcast Information Service
Log-In (requires registration)
Federal Government
Bureau of Indian Affairs
Department of Agriculture
Department of Defense
Department of Commerce
Department of Education
Department of Emergency Management
Department of Health and Human Services
Department of Labor
Department of State
Department of the Treasury
Department of Veterans Affairs
Department of Homeland Security
Department of the Interior
Department of Justice
Department of Transportation
Energy Information Agency
Department of Energy
Food and Drug Administration
Federal Aviation Administration
Federal Emergency Management Agency
White House
Links to Government WEB Sites
Minerals Management Service
Nuclear Regulatory Commission
Government Search
The Federal WEB Locator
Citizenship and Immigration Services
Office of Management and Budget
Government Executive
Gangs
Know Gangs
All Crip Gangs in Los AngelesCounty
Organized Crime Web Links
Gangs 101
Gangs Or Us
Gangs
Gang Intelligence Unit
Motorcycle Gangs Or Mafia
Organized Crime And Political Corruption
Gangs Before Thrasher
Gang Research
Gangs Around The World
Identifying Gang Members
Gang Symbols/Signs