idnits 2.17.1 draft-oreirdan-mody-bot-remediation-06.txt: Checking boilerplate required by RFC 5378 and the IETF Trust (see https://trustee.ietf.org/license-info): ---------------------------------------------------------------------------- ** You're using the IETF Trust Provisions' Section 6.b License Notice from 12 Sep 2009 rather than the newer Notice from 28 Dec 2009. (See https://trustee.ietf.org/license-info/) Checking nits according to https://www.ietf.org/id-info/1id-guidelines.txt: ---------------------------------------------------------------------------- No issues found here. Checking nits according to https://www.ietf.org/id-info/checklist : ---------------------------------------------------------------------------- No issues found here. Miscellaneous warnings: ---------------------------------------------------------------------------- == The copyright year in the IETF Trust and authors Copyright Line does not match the current year == The document doesn't use any RFC 2119 keywords, yet seems to have RFC 2119 boilerplate text. == The document seems to contain a disclaimer for pre-RFC5378 work, but was first submitted on or after 10 November 2008. The disclaimer is usually necessary only for documents that revise or obsolete older RFCs, and that take significant amounts of text from those RFCs. If you can contact all authors of the source material and they are willing to grant the BCP78 rights to the IETF Trust, you can and should remove the disclaimer. Otherwise, the disclaimer is needed and you can ignore this comment. (See the Legal Provisions document at https://trustee.ietf.org/license-info for more information.) -- The document date (February 10, 2010) is 5187 days in the past. Is this intentional? Checking references for intended status: Informational ---------------------------------------------------------------------------- No issues found here. Summary: 1 error (**), 0 flaws (~~), 3 warnings (==), 1 comment (--). Run idnits with the --verbose option for more detailed information about the items above. -------------------------------------------------------------------------------- 2 Internet Engineering Task Force J. Livingood 3 Internet-Draft N. Mody 4 Intended status: Informational M. O'Reirdan 5 Expires: August 14, 2010 Comcast 6 February 10, 2010 8 Recommendations for the Remediation of Bots in ISP Networks 9 draft-oreirdan-mody-bot-remediation-06 11 Abstract 13 This document contains recommendations on how Internet Service 14 Providers can manage the effects of computers used by their 15 subscribers, which have been infected with malicious bots, via 16 various remediation techniques. Internet users with infected 17 computers are exposed to risks such as loss of personal data, as well 18 as increased susceptibility to online fraud and/or phishing. Such 19 computers can also become an inadvertent participant in or component 20 of an online crime network, spam network, and/or phishing network, as 21 well as be used as a part of a distributed denial of service attack. 22 Mitigating the effects of and remediating the installations of 23 malicious bots will make it more difficult for botnets to operate and 24 could reduce the level of online crime on the Internet in general 25 and/or on a particular Internet Service Provider's network. 27 Status of this Memo 29 This Internet-Draft is submitted to IETF in full conformance with the 30 provisions of BCP 78 and BCP 79. 32 Internet-Drafts are working documents of the Internet Engineering 33 Task Force (IETF), its areas, and its working groups. Note that 34 other groups may also distribute working documents as Internet- 35 Drafts. 37 Internet-Drafts are draft documents valid for a maximum of six months 38 and may be updated, replaced, or obsoleted by other documents at any 39 time. It is inappropriate to use Internet-Drafts as reference 40 material or to cite them other than as "work in progress." 42 The list of current Internet-Drafts can be accessed at 43 http://www.ietf.org/ietf/1id-abstracts.txt. 45 The list of Internet-Draft Shadow Directories can be accessed at 46 http://www.ietf.org/shadow.html. 48 This Internet-Draft will expire on August 14, 2010. 50 Copyright Notice 52 Copyright (c) 2010 IETF Trust and the persons identified as the 53 document authors. All rights reserved. 55 This document is subject to BCP 78 and the IETF Trust's Legal 56 Provisions Relating to IETF Documents 57 (http://trustee.ietf.org/license-info) in effect on the date of 58 publication of this document. Please review these documents 59 carefully, as they describe your rights and restrictions with respect 60 to this document. Code Components extracted from this document must 61 include Simplified BSD License text as described in Section 4.e of 62 the Trust Legal Provisions and are provided without warranty as 63 described in the BSD License. 65 This document may contain material from IETF Documents or IETF 66 Contributions published or made publicly available before November 67 10, 2008. The person(s) controlling the copyright in some of this 68 material may not have granted the IETF Trust the right to allow 69 modifications of such material outside the IETF Standards Process. 70 Without obtaining an adequate license from the person(s) controlling 71 the copyright in such materials, this document may not be modified 72 outside the IETF Standards Process, and derivative works of it may 73 not be created outside the IETF Standards Process, except to format 74 it for publication as an RFC or to translate it into languages other 75 than English. 77 Table of Contents 79 1. Requirements Language . . . . . . . . . . . . . . . . . . . . 4 80 2. Key Terminology . . . . . . . . . . . . . . . . . . . . . . . 4 81 3. Introduction and Problem Statement . . . . . . . . . . . . . . 6 82 4. Important Notice of Limitations and Scope . . . . . . . . . . 7 83 5. Detection of Bots . . . . . . . . . . . . . . . . . . . . . . 8 84 6. Notification to Internet Users . . . . . . . . . . . . . . . . 12 85 7. Remediation of Compters Infected with a Bot . . . . . . . . . 17 86 8. Guided Remediation Process . . . . . . . . . . . . . . . . . . 18 87 9. Professionally-Assisted Remediation Process . . . . . . . . . 20 88 10. Security Considerations . . . . . . . . . . . . . . . . . . . 20 89 11. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 21 90 12. Acknowledgements . . . . . . . . . . . . . . . . . . . . . . . 21 91 13. Informative references . . . . . . . . . . . . . . . . . . . . 21 92 Appendix A. Document Change Log . . . . . . . . . . . . . . . . . 23 93 Appendix B. Open Issues . . . . . . . . . . . . . . . . . . . . . 24 94 Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . . 24 96 1. Requirements Language 98 The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT", 99 "SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this 100 document are to be interpreted as described in [RFC2119]. 102 2. Key Terminology 104 This section defines the key terms used in this document. 106 2.1. Malicious Bots, or Bots 108 A malicious "bot" (derived from the word "robot", hereafter simply 109 referred to as a "bot") refers to a program that is surreptitiously 110 installed on a system in order to enable that system to automatically 111 (or semi-automatically) perform a task or set of tasks typically 112 under the command and control of a remote administrator, or "bot 113 master." Bots are also known as "zombies". 115 It is important to note that there are 'good', or benign bots. Such 116 benign bots are often found in such environments such as gaming and 117 Internet Relay Chat (IRC) [RFC1459], where a continual, interactive 118 presence can be a requirement for participating in the games, 119 interacting with a computing resource, or other purposes. Since such 120 benign bots are performing useful, lawful, and non-disruptive 121 functions, there is no reason for a provider to monitor for their 122 presence and/or alert users to their presence. 124 Thus, while there may be benign bots, for the purposes of this 125 document all mention of bots shall assume that the bots involved are 126 malicious in nature. Such malicious bots shall generally be assumed 127 to have been deployed without the permission or conscious 128 understanding of a particular Internet user. Thus, without a user's 129 knowledge, bots may transform the user's computing device into a 130 platform from which malicious activities can be conducted. In 131 general, installation of a malicious bot without user knowledge and 132 consent is considered in most regions to be unlawful, and the 133 activities of malicious bots typically involve unlawful or other 134 maliciously disruptive activities. 136 2.2. Bot Networks, or Botnets 138 These are defined as concerted networks of bots capable of acting on 139 instructions generated remotely. The malicious activities are either 140 focused on the information on the local machine or acting to provide 141 services for remote machines. Bots are highly customizable so they 142 can be programmed to do many things. The major malicious activities 143 include: identity theft, spam, distributed denial of service (DDoS) 144 attacks, key-logging, fraudulent DNS (pharming), proxy services, fast 145 flux hosting and click fraud. 147 Infection vectors include un-patched operating systems, software 148 vulnerabilities, weak/non-existent passwords, malicious websites, un- 149 patched browsers, malware, vulnerable helper applications and social 150 engineering techniques to gain access to the user's computer. The 151 detection and destruction of bots is an ongoing issue and also a 152 constant battle between the internet security community, network 153 security engineers and bot developers. 155 Initially, bots used IRC to communicate but were easy to shutdown if 156 the command and control server was identified and deactivated. Newer 157 command and control methods have evolved, such that those currently 158 employed by bot masters make them much more resistant to 159 deactivation. With the introduction of P2P, HTTP and other resilient 160 communication protocols along with the widespread adoption of 161 encryption, bots are considerably more difficult to identify and 162 isolate from typical network usage. As a result increased reliance 163 is being placed on anonmaly detection and behavioral analysis, both 164 locally and remotely, to identify bots. 166 2.3. Computer 168 A computer, as used in the context of this document, is intended to 169 refer to a computing device that connects to the Internet. This 170 encompasses devices used by Internet users such as personal 171 computers, including laptops, desktops, and netbooks, as well as 172 mobile phones, smart phones, home gateway devices, and other end user 173 computing devices which are connected or can connect to the public 174 Internet and/or private IP networks. 176 Increasingly, other household systems and devices contain embedded 177 computers which are connected to or can connect to the public 178 Internet and/or private IP networks. However, these devices may not 179 be under interactive control of the Internet user, such as may be the 180 case with various smart home and smart grid devices. 182 2.4. Malware 184 This is short for malicious software. In this case, malicious bots 185 are considered a subset of malware. Other forms of malware could 186 include viruses and other similar types of software. Internet users 187 can sometimes cause their computer to be infected with malware, which 188 may include a bot or cause a bot to install itself, via inadvertently 189 accessing a specific website, downloading a specific file, or other 190 activities. 192 Alternatively, Internet-connected computers may become infected with 193 malware through externally initiated malicious activities such as the 194 exploitation of vulnerabilities or the brute force guessing of access 195 credentials. 197 2.5. Fast Flux 199 DNS Fast Fluxing occurs when a domain is bound in DNS using A records 200 to multiple IP addresses, each of which has a very short Time To Live 201 (TTL) value associated with it. This means that the domain resolves 202 to varying IP addresses over a short period of time. 204 DNS Fast Flux is typically used in conjunction with proxies which 205 then route the web requests to the real host which serves the data 206 being sought. The proxies are normally hosted on compromised user 207 computers. The effect of this is to make the detection of the real 208 host for a piece of content much more difficult and to ensure that 209 the site remains up for as long as possible. 211 3. Introduction and Problem Statement 213 Computers used by Internet users, which in this case are customers of 214 an Internet Service Provider (ISP), can be infected with malware 215 which may contain and/or install one or more bots on a computer. 216 This can present a major problem for an ISP for a number of reasons 217 (not to mention of course the problems created for users). First, 218 these bots can be used to send spam, in some cases very large volumes 219 of spam [Spamalytics: An Empirical Analysis of Spam Marketing 220 Conversion]. This spam can result in extra cost for the ISPs in 221 terms of wasted network, server, and/or personnel resources, among 222 many other potential costs and side effects. Such spam can also 223 negatively affect the reputation of the ISP, their customers, and the 224 email reputation of the IP address space used by the ISP (often 225 referred to simply as 'IP reputation'). 227 In addition, these bots can act as platforms for directing, 228 participating in, or otherwise conducting attacks on critical 229 Internet infrastructure [Emerging Cyber Threats Report for 2009: 230 Data, Mobility and Questions of Responsibility will Drive Cyber 231 Threats in 2009 and Beyond]. Bots are frequently used as part of 232 concerted Distributed Denial of Service (DDoS) attacks for criminal, 233 political or other motivations [The Gh0st in the Shell: Network 234 Security in the Himalayas] [The snooping dragon: social-malware 235 surveillance of the Tibetan movement]. For example, bots have been 236 used to attack Internet resources and infrastructure ranging from web 237 sites, to email servers and DNS servers, as well as the critical 238 Internet infrastructure of entire countries [Battling Botnets and 239 Online Mobs: Estonia's Defense Efforts during the Internet War] 240 [Cyberspace as a Combat Zone: The Phenomenon of Electronic Jihad]. 241 Motivations for such coordinated DDoS attacks can range from criminal 242 extortion attempts through to online protesting and nationalistic 243 fervor [Case Study: How a Bookmaker and a Whiz Kid Took On a 244 DDOS-based Online Extortion Attack]. 246 While any computing device can be infected with bots, the majority of 247 bot infections affect the personal computers used by Internet end 248 users. As a result of the role of ISPs in providing IP connectivity, 249 among many other services, to Internet users, these ISPs are in a 250 unique position to be able to attempt to detect and observe bot nets 251 operating in their networks. Furthermore, ISPs may also be in a 252 unique position to be able to communicate to Internet users which are 253 their customers, when customers' computers may have been determined 254 to have been or possibly have been infected with one or more bots. 256 From an end user perspective, knowing that their computer has been 257 infected with one or more bots is very important information. Once 258 they know this, they can take steps to remove the bot, protect 259 themselves in the future, and resolve any problems which may stem 260 from the bot infection. Given that bots can drain local computing 261 and network resources, enable theft of personal information 262 (including personal financial information), enable the computer to be 263 used from criminal activities (that may result in the Internet user 264 being legally culpable), destroy or leave the PC in an unrecoverable 265 state via 'kill switch' bot technologies, it is important to notify 266 the user that they may be infected with a bot. 268 As a result, the intent of this document is to provide a guide to 269 ISPs and other organizations for the remediation of these computers 270 infected with bots, so as to reduce the size of bot nets and minimize 271 the potential harm that bots can inflict upon Internet infrastructure 272 generally, as well as on individual Internet users. Efforts by ISPs 273 and other organizations could therefore, over time, reduce the pool 274 of computers infected with bots on the Internet, which in turn could 275 result in smaller bot nets with less capability for disruption. 277 The potential mitigation of bots is accomplished through a process of 278 detection, notification to Internet users, and remediation of that 279 bot with a variety of tools, as described later in this document. 281 4. Important Notice of Limitations and Scope 283 The techniques described in this document in no way guarantee the 284 remediation of all bots. Bot removal is potentially a task requiring 285 specialized knowledge, skills and tools, and may be beyond the 286 ability of average users. Attempts at bot removal may frequently be 287 unsuccessful, or only partially successful, and may leave a user's 288 system in an unstable and unsatisfactory state or even in a state 289 where it is still infected. Attempts at bot removal can also result 290 in side effects ranging from a loss of data or other files, all the 291 way through partial or complete loss of system usability. 293 In general, the only way a user can be sure they have removed some of 294 today's increasingly sophisticated malware is by 'nuking-and-paving' 295 the system: reformatting the drive, reinstalling the operating system 296 and applications (including all patches) from scratch, and then 297 restoring user files from a clean backup. However the introduction 298 of BIOS-based malware may mean that, in some cases, this will not be 299 enough and may prove to be more than any end user can be reasonably 300 expected to resolve [Persistent BIOS Infection]. Experienced users 301 would have to reflash BIOS in their machines in order to remove BIOS- 302 based malware. 304 Devices with embedded operating systems, such as video gaming 305 consoles and smart home appliances, will most likely be beyond a 306 user's capability to remediate by themselves, and will typically 307 require the aid of vendor-specific advice, updates and tools. Care 308 must be taken when imparting remediation advice to Internet users 309 given the increasingly wide array of computing devices that can be, 310 or could be, infected by bots in the future. 312 5. Detection of Bots 314 An ISP must first identify that an Internet user, in this case a user 315 that is assumed to be their customer or otherwise connected to the 316 ISP's network, is determined to be infected, or likely to have been 317 infected with a bot. The ISP must attempt to detect the presence of 318 bots using methods, processes, and tools which maintain the privacy 319 of the personally identifiable information (PII) of their customers. 320 The ISP also must not block legitimate traffic in the course of bot 321 detection, and must instead employ detection methods, tools, and 322 processes which seek to be non-disruptive, as well as being 323 transparent to Internet users and end-user applications. 325 Detection methods, tools, and processes may include things such as 326 analysis of specific network and/or application traffic flows (such 327 as traffic to an email server), analysis of aggregate network and/or 328 application traffic data, data feeds received from other ISPs and 329 organizations (such as lists of the ISP's IP addresses which have 330 been reported to have sent spam), feedback from the ISP's customers 331 or other Internet users, as well as a wide variety of other 332 possibilities. It is likely that a combination of multiple bot 333 detection data points will prove to be an effective approach in order 334 to corroborate information of varying dependability or consistency, 335 as well as to avoid or minimize the possibility of false positive 336 identification of computers. Detection should also, where possible 337 and feasible, attempt to classify a bot in order to confirm that it 338 is malicious in nature, estimate the variety and severity of threats 339 it may pose (such as spam bot, key-logging bot, file distribution 340 bot, etc.), and to determine potential methods for eventual 341 remediation. However, given the dynamic nature of botnet management 342 and the criminal incentives to seek quick financial rewards, botnets 343 frequently update or change their core malicious capabilities. As a 344 consequence, botnets that are initially detected and classified by 345 the ISP as one particular type of bot need to be continuously 346 monitored and tracked in order to correctly identify the threat they 347 pose at any particular point in time. 349 Detection is also time-sensitive. If complex analysis is required 350 and multiple confirmations are needed to confirm a bot is indeed 351 present, then it is possible that the bot may cause some damage (to 352 either the infected computer or a remotely targeted system) before it 353 can be stopped. This may mean that an ISP may need to balance the 354 desire or need to definitively classify and/or confirm a bot, which 355 may take an extended period of time, with the ability to predict the 356 strong likelihood of a bot in a very short period of time. This 357 'definitive-vs-likely' challenge is difficult and, when in doubt, 358 ISPs should probably err on the side of caution by communicating when 359 a likely bot infection has taken place. This also means that 360 Internet users may benefit from the deployment of client-based 361 software protections or other software tools, which can enable rapid 362 performance of heuristically-based detection bot activity, such as 363 the detection of a bot as it starts to communicate a bot net and 364 execute some type of command. Any bot detection systems should also 365 be capable of learning and adapting, either via manual intervention 366 or automatically, in order to cope with a rapidly evolving threat. 368 As noted above, detection methods, tools, and processes should ensure 369 that privacy of customers' PII is maintained. While bot detection 370 methods, tools, and processes are similar to spam and virus defenses 371 deployed by the ISP for the benefit of their customers (and may be 372 directly related to those defenses), attempts to detect bots should 373 take into account the need of an ISP to take care to ensure any PII 374 collected or incidentally detected is properly protected. The 375 definition of PII varies from one jurisdiction to the next so proper 376 care must be taken to ensure that any actions taken comply with 377 legislation and good practice in the jurisdiction in which the PII is 378 gathered. Finally, depending upon the geographic region within which 379 an ISP operates, certain methods relating to bot detection may need 380 to be included in relevant terms of service documents or other 381 documents which are available to the customers of a particular ISP. 383 There are several bot detection methods, tools, and processes that an 384 ISP may choose to utilize, as noted in the list below. It is 385 important to note that the technical solutions available are 386 relatively immature, and are likely to change over time, evolving 387 rapidly in the coming years. While these items are described in 388 relation to ISPs, they may also be applicable to organizations 389 operating other networks, such as campus networks and enterprise 390 networks. 392 a. Where legally permissible or otherwise an industry accepted 393 practice in a particular market region, an ISP may in some manner 394 "scan" their IP space in order to detect un-patched or otherwise 395 vulnerable hosts. This may provide the ISP with the opportunity 396 to easily identify Internet users who appear to already be or are 397 at great risk of being infected with a bot. ISP's should note 398 that some types of port scanning may leave network services in a 399 hung state or render them unusable due to common frailties, and 400 that many modern firewall and host-based intrusion detection 401 implementations may alert the Internet user to the scan. As a 402 result the scan may be interpreted as a malicious attack against 403 the computer. Vulnerability scanning has a higher probability of 404 leaving accessible network services and applications in a damaged 405 state and will often result in a higher probability of detection 406 by the Internet user and subsequent interpretation as a targeted 407 attack. Depending upon the vulnerability being scanned, some 408 automated methods of vulnerability checking may result in data 409 being altered or created afresh on the Internet users computer 410 which be a problem in many legal environments. 412 b. An ISP may also communicate and share selected data, via feedback 413 loops or other mechanisms, with various third parties. Feedback 414 loops are consistently formatted feeds of real-time (or nearly 415 real-time) abuse reports offered by threat data clearinghouses, 416 security alert organizations, other ISPs, and other 417 organizations. The data may include, but is not limited to, 418 lists of the IP addresses computers which have or are likely to 419 have a bot running, domain names or fully qualified domain names 420 (FQDNs) known to host malware and/or be involved in the command 421 and control of botnets, IP addresses know to host malware and/or 422 be involved in the command and control of botnets, recently 423 tested or discovered techniques or detecting or remediating bot 424 infections, new threat vectors, and other relevant information. 425 Good examples of this include SNDS from Microsoft, XBL and PBL 426 from Spamhaus and the DSHIELD AS tool from the SANS Institue. 428 c. An ISP may use Netflow [RFC3954] or other similar passive network 429 monitoring to identify network anomalies that may be indicative 430 of botnet attacks or bot communications. For example, an ISP may 431 be able to identify compromised hosts by identifying traffic 432 destined to IP addresses associated with the command and control 433 of botnets. In addition, bots can be idenfied when a remote host 434 is under a DDoS attack because computers participating in the 435 attack will likely be infected by a bot, frequently as observed 436 at network borders. 438 d. An ISP may use DNS-based techniques to perform detection. For 439 example, a given classified bot may be known to query a specific 440 list of domain names at specific times or on specific dates (in 441 the example of the so-called "Conficker" bot), often by matching 442 DNS queries to a well known list of domains associated with 443 malware. In many cases such lists are distributed by or shared 444 using third parties, such as threat data clearinghouses. 446 e. User complaints: Because hosts infected by bots are frequently 447 used to send spam or participate in DDoS attacks, the ISP 448 servicing those hosts will normally receive complaints about the 449 malicious network traffic. Those complaints may be sent to 450 RFC2142-specified [RFC2142] role accounts, such as abuse@ or 451 postmaster@ or to abuse or security addresses specified by the 452 site as part of its WHOIS (or other) contact data. 454 f. ISPs may also discover likely bot infected hosts located at other 455 sites; when legally permissible or otherwise an industry accepted 456 practice in a particular market region, it may be worthwhile for 457 ISPs to share evidence relating to those compromised hosts with 458 the relevant remote ISP, with security researchers, and with 459 blocklist operators. 461 g. ISPs may operate or subscribe to services that provide 462 'sinkholing' or 'honeynet' capabilities. This may enable the ISP 463 to obtain near-real-time lists of bot infected computers as they 464 attempt to join a larger botnet or propagate to other hosts on a 465 network. 467 h. ISP industry associations should examine the possiblity of 468 collating statistics from ISP members in order to provide good 469 statistics about bot infections based on real ISP data. 471 i. An Intrusion Detection System(IDS) can be a useful tool to 472 actually identify to help identify the malware. An IDS tool such 473 as SNORT (open source IDS platform) can be placed in a Walleed 474 Garden and used to analyse end user traffic to confirm malware 475 type. This will help with remediation of the infected device. 477 6. Notification to Internet Users 479 Once an ISP has detected a bot, or the strong likelihood of a bot, 480 steps should be undertaken to inform the Internet user that they may 481 have a bot-related problem. Depending upon a range of factors, from 482 the technical capabilities of the ISP, to the technical attributes of 483 their network, financial considerations, available server resources, 484 available organizational resources, the number of likely infected 485 computers detected at any given time, and the severity of any 486 possible threats, among many other things, an ISP should decide the 487 most appropriate method or methods for providing notification to one 488 or more of their customers or Internet users. Such notification 489 methods may include one or more of the following, as well as other 490 possible methods not described below 492 It is important to note that none of these methods are guaranteed to 493 be successful, and that each has its own set of limitations. In 494 addition, in some cases, an ISP may determine that a combination of 495 two or more methods is most appropriate. Finally, notification is 496 also considered time sensitive; if the user does not receive or view 497 the notification or a timely basis, then a particular bot could 498 launch an attack, exploit the user, or cause other harm. If 499 possible, an ISP should establish a preferred means of communication 500 when the subscriber first signs up for service. As a part of the 501 notification process, ISPs should maintain a record of the allocation 502 of IP addresses to subscribers for such a period as allows any bot 503 detection technology to be accurately able to link an infected IP 504 address to a subscriber. This record should only be maintained for a 505 period of time which is necessary, in order to maintain the 506 protection of the privacy of an individual subscriber. 508 One important factor to bear in mind is that notification to end 509 users needs to be defended against spoofing by third parties. This 510 must be done to protect against the possibility of notifications 511 being spoofed and used by bots to deliver additional malware. 513 6.1. Email Notification 515 This is probably the most common form of notification used by ISPs. 516 One drawback of using email is that it is not guaranteed to be viewed 517 within a reasonable time frame, if at all. The user may be using a 518 different primary email address than that which they have provided to 519 the ISP. In addition, some ISPs do not provide an email account at 520 all, as part of a bundle of Internet services, and/or do not have a 521 need for or method in which to request or retain the primary email 522 addresses of Internet users of their networks. Another possibility 523 is that the user, their email client, and/or their email servers 524 could determine or classify such a notification as spam, which could 525 delete the message or otherwise file it in an email folder that the 526 user may not check on a regular and/or timely basis. Bot masters 527 have also been known to impersonate the ISP or trusted sender and 528 send fradulant emails to the users. This technique of solical 529 engineering, generally referred to as 'phishing', often leads to new 530 bot infestations. Finally if the user's email credentials are 531 compromised, then a hacker and/or a bot could simply login to the 532 user's email account and delete the email before it is read by the 533 user. 535 6.2. Telephone Call Notification 537 A telephone call may be an effective means of communication in 538 particularly high-risk situations. However, telephone calls may not 539 be feasible due to the cost of making a large number of calls, as 540 measured in either time, money, organizational resources, server 541 resources, or some other means. In addition, there is no guarantee 542 that the user will answer their phone. To the extent that the 543 telephone number called by the ISP can be answered by the infected 544 computing device, the bot on that computer may be able to disconnect, 545 divert, or otherwise interfere with an incoming call. Users may also 546 interpret such a telephone notification as a telemarketing call and 547 as such not welcome it, or not accept the call at all. Finally, even 548 if a representative of the ISP is able to connect with and speak to a 549 user, that user is very likely to lack the necessary technical 550 expertise to understand or be able to effectively deal with the 551 threat. 553 6.3. Postal Mail Notification 555 This form of notification is probably the least popular and effective 556 means of communication, due to both preparation time, delivery time, 557 the cost of printing and paper, and the cost of postage. 559 6.4. Walled Garden Notification 561 Placing a user in a walled garden is another approach that ISPs may 562 take to notify users. A walled garden refers to an environment that 563 controls the information and services that a subscriber is allowed to 564 utilize and what network access permissions are granted. This is an 565 effective technique because it could be able to block all 566 communication between the bot and the command and control channel, 567 which may impair the ability of a bot to disrupt or block attempts to 568 notify the user. 570 While in many cases the user is almost guaranteed to view the 571 notification message and take any appropriate remediation actions, 572 this approach poses can pose other challenges. For example, it is 573 not always the case that a user is actively using a computer that 574 uses a web browser or which has a web browser actively running on it. 575 In one example, a user could be playing a game online, via the use of 576 a dedicated, Internet-connected game console. In another example, 577 the user may not be using a computer with a web browser when they are 578 placed in the walled garden and may instead be in the course of a 579 telephone conversation, or may be expecting to receive a call, using 580 a Voice Over IP (VoIP) device of some type. As a result, the ISP may 581 feel the need to maintain a potentially lengthy white list of domains 582 which are not subject to the typical restrictions of a walled garden, 583 which could well prove to be an onerous task, from an operational 584 perspective. 586 The ISP has several options to determine when to let the user out of 587 the walled garden. One approach may be to let the user determine 588 when to exit. This option is suggested when the purpose of the 589 walled garden is to notify users and provide information on 590 remediation only, particularly since notification is not a guarantee 591 of successful remediation. It could also be the case that, for 592 whatever reason, the user makes the judgment that they cannot then 593 take the time to remediate their computer and that other online 594 activities which they would like to resume are more important. Exit 595 from the walled garden may also involve a process to verify that it 596 is indeed the user who is requesting exit from the walled garden and 597 not the bot. 599 Once the user acknowledges the notification, then the user decides to 600 either remediate and then exit the walled garden, or exit the walled 601 garden without addressing the issue. Another approach may be to 602 enforce a stricter policy and require the user to clean the computer 603 prior to permitting the user to exit the walled garden, though this 604 may not be technically feasible depending upon the type of bot, 605 obfuscation techniques employed by a bot, and/or a range of other 606 factors. Thus, the ISP may also need to support tools to scan the 607 infected computer and determine whether it is still infected or rely 608 on user judgment that the bot has been disabled or removed. One 609 challenge with this approach is that if the user has multiple 610 computers sharing a single IP address, such as via a common home 611 gateway device which performs Network Address Translation (NAT). In 612 such a case, the ISP may need to determine from user feedback, or 613 other means, that all affected computers have been remediated, which 614 may or may not be technically feasible. 616 Finally, when a walled garden is used, a list of well-known addresses 617 for both operating system vendors and security vendors should be 618 created and maintained in a white list which permits access to these 619 sites. This can be important for allowing access from the walled 620 garden by end users in search of operating system and application 621 patches. 623 6.5. Instant Message Notification 625 Instant messaging provides the ISP with a simple means to communicate 626 with the user. There are several advantages to using IM which makes 627 it an attractive option. If the ISP provides IM service and the user 628 subscribes to it, then the user can be notified easily. IM-based 629 notification can be a cost effective means to communicate with users 630 automatically from an IM alert system or via a manual process, by the 631 ISP's support staff. Ideally, the ISP should allow the user to 632 register their IM identity in an ISP account management system and 633 grant permission to be contacted via this means. If the IM service 634 provider supports off-line messaging, then the user can be notified 635 regardless of whether they are currently logged into the IM system. 637 There are several drawbacks with this communications method. There 638 is a high probability that subscriber may interpret the communication 639 to be spam, and as such ignore it. Also, not every user uses IM 640 and/or the user may not provide their IM identity to the ISP so some 641 alternative means have to be used. Even in those cases where a user 642 does have an IM address, they may not be signed onto that IM system 643 when the notification is attempted. There maybe also be a privacy 644 concern on the part of users, when such an IM notification must be 645 transmitted over a third-party network and/or IM service. As such, 646 should this method be used, the notification should be discreet and 647 not include any PII in the notification itself. 649 6.6. Short Message Service (SMS) Notification 651 SMS allows the ISP send a brief description of the problem to notify 652 the user of the issue, typically to a mobile device such as a mobile 653 phone or smart phone. Ideally, the ISP should allow the user to 654 register their mobile number and/or SMS address in an ISP account 655 management system and grant permission to be contacted via this 656 means. The primary advantage of SMS is that users are familiar with 657 receiving text messages and are likely to read them. However, users 658 may not act on the notification immediately if they are not in front 659 of their computer system at the time of the SMS notification. 661 One disadvantage is that ISPs may have to follow up with an alternate 662 means of notification if not all of the necessary information maybe 663 conveyed in one message, given constraints on the number of 664 characters in an individual message (typically 140 characters). 665 Another disadvantage with SMS is the cost associated with it. The 666 ISP has to either build its own SMS gateway to interface with the 667 various wireless network service providers or use a third-party SMS 668 clearinghouse (relay) to notify users. In both cases, an ISP will 669 typically pay on a per-message basis to send SMS notifications. An 670 additional downside is that SMS messages sent to a user may result in 671 a charge to the user by their wireless provider, depending upon the 672 plat to which they subscribe. Another minor disadvantage is that it 673 is possible to notify the wrong user if the intended user changes 674 their mobile number but forgets to update it with the ISP. 676 There are several other drawbacks with this communications method. 677 There is a high probability that subscriber may interpret the 678 communication to be spam, and as such ignore it. Also, not every 679 user uses SMS and/or the user may not provide their SMS address or 680 mobile number to the ISP. Even in those cases where a user does have 681 an SMS address or mobile number, their device may not be powered on 682 or otherwise available on a wireless network when the notification is 683 attempted. There maybe also be a privacy concern on the part of 684 users, when such an SMS notification must be transmitted over a 685 third-party network and/or SMS clearinghouse. As such, should this 686 method be used, the notification should be discreet and not include 687 any PII in the notification itself. 689 6.7. Web Browser Notification 691 Near real-time notification to the user's web browser is another 692 technique that may be utilized for notifying the user, though how 693 such a system might operate is outside the scope of this document. 694 Such a notification could have a comparative advantage over a walled 695 garden notification, in that it does not restrict traffic to a 696 specified list of destinations in the same way that a walled garden 697 by definition would. However, as with a walled garden notification, 698 there is no guarantee that a user is at any given time making use of 699 a web browser, though such a system could certainly provide a 700 notification when such a browser is eventually used. Compared to a 701 walled garden, a web browser notification is probably preferred from 702 the perspective of Internet users, as it does not have the risk of 703 disrupting non-web sessions, such as online games, VoIP calls, etc. 704 (as noted in Section 6.4). 706 6.8. Considerations for Notification to Public Network Locations 708 Delivering a notification to a location that provides a shared public 709 network, such as a train station, public square, coffee shop, or 710 similar location may be of low value since the users connecting to 711 such networks are typically highly transient and generally not know 712 to site or network administrators. For example, a system may detect 713 that a computer on such a network has a bot, but by the time a 714 notification is generated that user has departed from the network and 715 moved elsewhere. 717 6.9. Considerations for Notification to Network Locations Using a 718 Shared IP Address 720 Delivering a notification to a location that Internet access routed 721 through one or more shared public IP addresses may be of low value 722 since it may be quite difficult to differentiate between users when 723 providing a notification. For example, on a business network of 500 724 users, all sharing one public IP address, it may be sub-optimal to 725 provide a notification to all 500 users if you only need one specific 726 user to be notified and take action. As a result, such networks may 727 find value in establishing a localized bot detection and notification 728 system, just as they are likely to also establish other localized 729 systems for security, file sharing, email, and so on. 731 7. Remediation of Compters Infected with a Bot 733 This section covers the different options available to remediate a 734 computer, which means to remove, disable, or otherwise render a bot 735 harmless. Prior to this step, an ISP has detected the bot, notified 736 the user that one of their computers is infected with a bot, and now 737 may provide some recommended means to clean the computer. The 738 generally recommended approach is to provide the necessary tools and 739 education to the user so that they may perform bot remediation 740 themselves, particularly given the risks and difficulties inherent in 741 attempting to remove a bot. 743 For example, this may include the creation of a special web site with 744 security-oriented content that is dedicated for this purpose. This 745 should be a well-publicized security web site to which a user with a 746 bot infection can be directed to for remediation. This security web 747 site should clearly explain why the user was notified and may include 748 an explanation of what bots are, and the threats that they pose. 749 There should be a clear explanation of the steps that the user should 750 take in order to attempt to clean their computer and provide 751 information on how users can keep the computer free of future 752 infections. The security web site should also have a guided process 753 that takes non-technical users through the remediation process, on an 754 easily understood, step-by-step basis. 756 In terms of the text used to explain what bots are and the threats 757 that they pose, something simple such as this may suffice: 759 "What is a bot? A bot is a piece of software, generally 760 installed on your machine without your knowledge, which either 761 sends spam or tries to steal your personal information. They 762 can be very difficult to spot, though you may have noticed that 763 your computer is running much more slowly than usual or you 764 notice regular disk activity even when you are not doing 765 anything. Ignoring this problem is not really an option since 766 your personal information is currently at risk. Thus, bots 767 need to be removed to protect your data and your personal 768 information." 770 It is also important to note that it may not be immediately apparent 771 to the Internet user precisely which devices have been infected with 772 a particular bot. This may be due to the user's home network 773 configuration, which may encompass several computers, where a home 774 gateway which performs Network Address Translation (NAT) to share a 775 single public IP address has been used. Therefore, any of these 776 devices can be infected with a bot. The consequence of this for an 777 ISP is that remediation advice may not ultimately be immediately 778 actionable by the Internet user, as that user may need to perform 779 additional investigation within their own home network. 781 An added complication is that the user may have a bot infection on a 782 device such as a video console, multimedia system, appliance, or 783 other end-user computing device which does not have a typical Windows 784 or Macintosh user interface. As a result, diligence needs to be 785 taken by the ISP where possible such that they can identify and 786 communicate the specific nature of the device that has been infected 787 with a bot, and further providing appropriate remediation advice. 789 There are a number of forums that exist online to provide security 790 related support to end users. These forums are staffed by volunteers 791 and often are focussed around the use of a common tool set to help 792 end users to remediate computers infected with malware. It may be 793 advantageous to ISPs to foster a relationship with one or more 794 forums, perhaps by offering free hosting or other forms of 795 sponsorship. 797 8. Guided Remediation Process 799 Minimally the Guided Remediation Process should include options 800 and/or recommendations on how a user should: 802 1. Backup personal Documents, for example: "Before you start, make 803 sure to back up all of your important data. (You should do this 804 on a regular basis anyway.) You can back up your files manually 805 or using a system back-up software utility, which may be part of 806 your Operating System (OS). You can back your files up to a USB 807 Thumb Drive (aka USB Key), a writeable CD/DVD-ROM, an external 808 hard drive, or a network file server." 810 2. Download OS patches and Anti-Virus (A/V) software updates. For 811 example, links could be provided to Microsoft Windows updates at 812 http://update.microsoft.com/microsoftupdate/v6/ 813 default.aspx?ln=en-us as well as to Apple MacOS updates at 814 http://support.apple.com/kb/HT1338?viewlocale=en_US. 816 3. Explain how to configure the computer to automatically install 817 updates for the OS, A/V and other common Web Browsers such as 818 Microsoft Internet Explorer, Mozilla Firefox, Apple Safari, 819 Opera, and Google Chrome. 821 4. The flow should also have the option for users to get 822 professional assistance if they are unable to remove the bots 823 themselves. If purchasing third party assistance, then the user 824 should be encouraged to pre-determine how much they are willing 825 to pay for that help. If the computer that is being remediated 826 is old and can easily be replaced with a new, faster, larger and 827 more reliable system for three or four hundred dollars, the it 828 makes no sense to spend five or six hundred dollars to fix the 829 old computer, for example. On the other hand, if the customer 830 has a brand new computer that cost several thousand dollars, it 831 might make perfect sense to spend the money in attempting to 832 remediate it. 834 5. To continue, regardless of whether the user or a knowledgeable 835 technical assistant is working on remediating the computer, their 836 first task should be to determine which of multiple potentially- 837 infected machines may be the one that needs attention (in the 838 common case of multiple computers in a home network). Sometimes, 839 as in cases where there is only a single directly-attached 840 computer, or the user has been noticing problems with one of 841 their computers, this can be easy. Other times, it may be more 842 difficult. If the user is behind a home gateway/router, then the 843 first task may be to ascertain which of the machines is infected. 844 In some cases the user may have to check all machines to identify 845 the infected one. 847 6. User surveys to solicit feedback on whether the notification and 848 remediation process is effective and what recommended changes 849 could be made in order to improve the ease, understandability, 850 and effectiveness the remediation process. 852 7. If the user is interested in reporting his or her computer's bot 853 infection to an applicable law enforcement authority, then the 854 computer effectively becomes a cyber "crime scene" and should not 855 be mitigated unless or until law enforcement has collected the 856 necessary evidence. For individuals in this situation, the ISP 857 should refer them to local, state, federal, or other relevant 858 computer crime offices. (Note: Some "minor" incidents, even if 859 highly traumatic to the user, may not be sufficiently serious for 860 law enforcement to commit some of their limited resources to an 861 investigation.) In addition, individual regions may have other, 862 specialized computer crime organizations to which these incidents 863 can be reported. For example, in the United States, that 864 organization is the Internet Crime Complaint Center, at 865 http://www.ic3.gov. 867 8. Users may also be interested in links to security expert forums, 868 where other users can assist them. 870 9. Professionally-Assisted Remediation Process 872 It should be acknowledged that, based on the current state of 873 remediation tools and the technical abilities of end users, that many 874 users may be unable to remediate on their own. As a result, it is 875 recommended that users have the option to avail themselves of 876 professional assistance. This may entail online or telephone 877 assistance for remediation, as well as working face to face with a 878 professional who has training and expertise in the removal of 879 malware. 881 10. Security Considerations 883 This document describes in detail the numerous security risks and 884 concerns relating to bot nets. As such, it has been appropriate to 885 include specific information about security in each section above. 886 This document describes the security risks related to malicious bot 887 infections themselves, such as enabling identity theft, theft of 888 authentication credentials, and the use of a computer to unwittingly 889 participate in a DDoS attack, among many other risks. This document 890 also describes at a high level the activities that ISPs should be 891 sensitive to, where the collection or communication of PII may be 892 possible. Finally, the document also describes security risks which 893 may relate to the particular methods of communicating a notification 894 to Internet users. Bot networks and bot infections pose extremely 895 serious security risks and any reader should review this document 896 carefully. 898 In addition, regarding notifications, as described in the Section 6, 899 care should be taken to assure users that notifications have been 900 provided by a trustworthy site and/or party, so that the notification 901 is more difficult for phishers to mimic, or that the user has some 902 level of trust that the notification is valid, and/or that the user 903 has some way to verify via some other mechanism or step that the 904 notification is valid. 906 11. IANA Considerations 908 There are no IANA considerations in this document. 910 12. Acknowledgements 912 The authors wish to acknowledge the following individuals and 913 organisations for their review and feedback of this document: 915 Jonathan Curtis 917 Jeff Chan 919 Roland Dobbins 921 Eliot Gillum 923 Joel Halpern 925 The Messaging Anti-Abuse Working Group (MAAWG) 927 Jose Nazario 929 Gunter Ollmann 931 Joe Stewart 933 Eric Ziegast 935 13. Informative references 937 [Battling Botnets and Online Mobs: Estonia's Defense Efforts during 938 the Internet War] 939 Evron, G., "Battling Botnets and Online Mobs: Estonia's 940 Defense Efforts during the Internet War", May 2005, . 946 [Case Study: How a Bookmaker and a Whiz Kid Took On a DDOS-based 947 Online Extortion Attack] 948 Berinato, S., "Case Study: How a Bookmaker and a Whiz Kid 949 Took On a DDOS-based Online Extortion Attack", May 2005, < 950 http://www.csoonline.com/article/220336/ 951 How_a_Bookmaker_and_a_Whiz_Kid_Took_On_a_DDOS_based_Online 952 _Extortion_Attack>. 954 [Cyberspace as a Combat Zone: The Phenomenon of Electronic Jihad] 955 Alshech, E., "Cyberspace as a Combat Zone: The Phenomenon 956 of Electronic Jihad", February 2007, . 959 [Emerging Cyber Threats Report for 2009: Data, Mobility and Questions 960 of Responsibility will Drive Cyber Threats in 2009 and Beyond] 961 Ahamad, M., Amster, D., Barret, M., Cross, T., Heron, G., 962 Jackson, D., King, J., Lee, W., Naraine, R., Ollman, G., 963 Ramsey, J., Schmidt, H., and P. Traynor, "Emerging Cyber 964 Threats Report for 2009: Data, Mobility and Questions of 965 Responsibility will Drive Cyber Threats in 2009 and 966 Beyond", October 2008, . 969 [Persistent BIOS Infection] 970 Sacco, A. and A. Ortega, "Persistent BIOS Infection", 971 March 2009, . 974 [RFC1459] Oikarinen, J. and D. Reed, "Internet Relay Chat Protocol", 975 RFC 1459, May 1993. 977 [RFC2119] Bradner, S., "Key words for use in RFCs to Indicate 978 Requirement Levels", BCP 14, RFC 2119, March 1997. 980 [RFC2142] Crocker, D., "MAILBOX NAMES FOR COMMON SERVICES, ROLES AND 981 FUNCTIONS", RFC 2142, May 1997. 983 [RFC3954] Claise, B., "Cisco Systems NetFlow Services Export Version 984 9", RFC 3954, October 2004. 986 [Spamalytics: An Empirical Analysis of Spam Marketing Conversion] 987 Kanich, C., Kreibich, C., Levchenko, K., Enright, B., 988 Voelker, G., Paxson, V., and S. Savage, "Spamalytics: An 989 Empirical Analysis of Spam Marketing Conversion", 990 October 2008, . 993 [The Gh0st in the Shell: Network Security in the Himalayas] 994 Vallentin, M., Whiteaker, J., and Y. Ben-David, "The Gh0st 995 in the Shell: Network Security in the Himalayas", 996 February 2010, . 999 [The snooping dragon: social-malware surveillance of the Tibetan 1000 movement] 1001 Nagaraja, S. and R. Anderson, "The snooping dragon: 1002 social-malware surveillance of the Tibetan movement", 1003 March 2009, 1004 . 1006 Appendix A. Document Change Log 1008 [RFC Editor: This section is to be removed before publication] 1010 -06 version: 1012 o Corrected an error in the version change log, and added some extra 1013 information on user remediation. Also added an informational 1014 reference to BIOS infection. 1016 -05 version: 1018 o Minor tweaks made by Jason - ready for wider review and next 1019 steps. Also cleared open issues. Lastly, added 2nd paragraph to 1020 security section and added sections on limitations relating to 1021 public and other shared network sites. Added a new section on 1022 professional remediation. 1024 -04 version: 1026 o Updated reference to BIOS based malware, added wording on PII and 1027 local jurisdictions, added suggestion that industry body produce 1028 bot stats, added suggestion that ISPs use volunteer forums 1030 -03 version: 1032 o all updates from Jason - now ready for wider external review 1034 -02 version: 1036 o all updates from Jason - still some open issues but we're now at a 1037 place where we can solicit more external feedback 1039 -01 version: 1041 o -01 version published 1043 Appendix B. Open Issues 1045 [RFC Editor: This section is to be removed before publication] 1047 None at this time 1049 Authors' Addresses 1051 Jason Livingood 1052 Comcast Cable Communications 1053 One Comcast Center 1054 1701 John F. Kennedy Boulevard 1055 Philadelphia, PA 19103 1056 US 1058 Email: jason_livingood@cable.comcast.com 1059 URI: http://www.comcast.com 1061 Nirmal Mody 1062 Comcast Cable Communications 1063 One Comcast Center 1064 1701 John F. Kennedy Boulevard 1065 Philadelphia, PA 19103 1066 US 1068 Email: nirmal_mody@cable.comcast.com 1069 URI: http://www.comcast.com 1071 Mike O'Reirdan 1072 Comcast Cable Communications 1073 One Comcast Center 1074 1701 John F. Kennedy Boulevard 1075 Philadelphia, PA 19103 1076 US 1078 Email: michael_oreirdan@cable.comcast.com 1079 URI: http://www.comcast.com