Active Members Fi8sVrs Posted November 11, 2013 Active Members Report Posted November 11, 2013 Current Release:http://www.rfxn.com/downloads/maldetect-current.tar.gzhttp://www.rfxn.com/appdocs/README.maldetecthttp://www.rfxn.com/appdocs/CHANGELOG.maldetectDescriptionLinux Malware Detect (LMD) is a malware scanner for Linux released under the GNU GPLv2 license, that is designed around the threats faced in shared hosted environments. It uses threat data from network edge intrusion detection systems to extract malware that is actively being used in attacks and generates signatures for detection. In addition, threat data is also derived from user submissions with the LMD checkout feature and from malware community resources. The signatures that LMD uses are MD5 file hashes and HEX pattern matches, they are also easily exported to any number of detection tools such as ClamAV.The driving force behind LMD is that there is currently limited availability of open source/restriction free tools for Linux systems that focus on malware detection and more important that get it right. Many of the AV products that perform malware detection on Linux have a very poor track record of detecting threats, especially those targeted at shared hosted environments.The threat landscape in shared hosted environments is unique from that of the standard AV products detection suite in that they are detecting primarily OS level trojans, rootkits and traditional file-infecting viruses but missing the ever increasing variety of malware on the user account level which serves as an attack platform.Using the CYMRU malware hash registry, which provides malware detection data for 30 major AV packages, we can demonstrate this short coming in current threat detection. The following is an analysis of the core MD5 hashes (5,393) in LMD 1.4.0 and the percentage of major AV products that currently detect the hashes.KNOWN MALWARE: 1029% AV DETECT (AVG): 48% AV DETECT (LOW): 58% AV DETECT (HIGH): 80UNKNOWN MALWARE: 4364What this information means, is that of the of the 5,393 hashes, 81% or 4,364 malware items are not detected / known by the top 30 major AV packages. The 1,029 malware items that are known / detected have an average of a 48% detection rate among major AV packages with a low / high margin of detection at 58 and 80 percent respective. This clearly demonstrates the lacking capability in currently available tools and why it is important that something fill the void, especially in the Linux shared hosted environment.Features:- MD5 file hash detection for quick threat identification- HEX based pattern matching for identifying threat variants- statistical analysis component for detection of obfuscated threats (e.g: base64)- integrated detection of ClamAV to use as scanner engine for improved performance- integrated signature update feature with -u|–update- integrated version update feature with -d|–update-ver- scan-recent option to scan only files that have been added/changed in X days- scan-all option for full path based scanning- checkout option to upload suspected malware to rfxn.com for review / hashing- full reporting system to view current and previous scan results- quarantine queue that stores threats in a safe fashion with no permissions- quarantine batching option to quarantine the results of a current or past scans- quarantine restore option to restore files to original path, owner and perms- quarantine suspend account option to Cpanel suspend or shell revoke users- cleaner rules to attempt removal of malware injected strings- cleaner batching option to attempt cleaning of previous scan reports- cleaner rules to remove base64 and gzinflate(base64 injected malware- daily cron based scanning of all changes in last 24h in user homedirs- daily cron script compatible with stock RH style systems, Cpanel & Ensim- kernel based inotify real time file scanning of created/modified/moved files- kernel inotify monitor that can take path data from STDIN or FILE- kernel inotify monitor convenience feature to monitor system users- kernel inotify monitor can be restricted to a configurable user html root- kernel inotify monitor with dynamic sysctl limits for optimal performance- kernel inotify alerting through daily and/or optional weekly reports- e-mail alert reporting after every scan execution (manual & daily)- path, extension and signature based ignore options- background scanner option for unattended scan operations- verbose logging & output of all actionsSource Data:The defining difference with LMD is that it doesn’t just detect malware based on signatures/hashes that someone else generated but rather it is an encompassing project that actively tracks in the wild threats and generates signatures based on those real world threats that are currently circulating.There are four main sources for malware data that is used to generate LMD signatures:- Network Edge IPS: The network I manage hosts over 35,000 web sites and as such receives a large amount of daily abuse, all of which is logged by our network edge IPS. The IPS events are processed to extract malware url’s, decode POST payload and base64/gzip encoded abuse data and ultimately that malware is retrieved, reviewed, classified and then signatures generated as appropriate. The vast majority of LMD signatures have been derived from IPS extracted data.- Community Data: Data is aggregated from multiple community malware websites such as clean-mx and malwaredomainlist then processed to retrieve new malware, review, classify and then generate signatures.- ClamAV: The HEX & MD5 detection signatures from ClamAV are monitored for relevant updates that apply to the target user group of LMD and added to the project as appropriate. To date there has been roughly 400 signatures ported from ClamAV while the LMD project has contributed back to ClamAV by submitting over 1,100 signatures and continues to do so on an ongoing basis.- User Submission: LMD has a checkout feature that allows users to submit suspected malware for review, this has grown into a very popular feature and generates on average about 30-50 submissions per week.Signature Updates:The LMD signature are updated typically once per day or more frequently depending on incoming threat data from the LMD checkout feature, IPS malware extraction and other sources. The updating of signatures in LMD installations is performed daily through the default cron.daily script with the –update option, which can be run manually at any time.An RSS feed is available for tracking malware threat updates: http://www.rfxn.com/api/lmdDetected Threats:LMD 1.4.0 has a total of 7,241 (5393 MD5 / 1848 HEX) signatures (before updates), below is a listing of the top 60 threats by prevalence detected by LMD:base64.inject.unclassed perl.ircbot.xscanbin.dccserv.irsexxy perl.mailer.yellsoftbin.fakeproc.Xnuxer perl.shell.cbLorDbin.ircbot.nbot perl.shell.cgitelnetbin.ircbot.php3 php.cmdshell.c100bin.ircbot.unclassed php.cmdshell.c99bin.pktflood.ABC123 php.cmdshell.cihbin.pktflood.osf php.cmdshell.egyspiderbin.trojan.linuxsmalli php.cmdshell.fx29c.ircbot.tsunami php.cmdshell.ItsmYarDexp.linux.rstb php.cmdshell.Ketemuexp.linux.unclassed php.cmdshell.N3tshellexp.setuid0.unclassed php.cmdshell.r57gzbase64.inject php.cmdshell.unclassedhtml.phishing.auc61 php.defash.bunohtml.phishing.hsbc php.exe.globalsperl.connback.DataCha0s php.include.remoteperl.connback.N2 php.ircbot.InsideTeamperl.cpanel.cpwrap php.ircbot.lolwutperl.ircbot.atrixteam php.ircbot.sniperperl.ircbot.bRuNo php.ircbot.vj_denieperl.ircbot.Clx php.mailer.10hackperl.ircbot.devil php.mailer.bombamperl.ircbot.fx29 php.mailer.PostManperl.ircbot.magnum php.phishing.AliKayperl.ircbot.oldwolf php.phishing.mrbrainperl.ircbot.putr4XtReme php.phishing.ReZulTperl.ircbot.rafflesia php.pktflood.oeyperl.ircbot.UberCracker php.shell.rc99perl.ircbot.xdh php.shell.shellcommReal-Time Monitoring:The inotify monitoring feature is designed to monitor paths/users in real-time for file creation/modify/move operations. This option requires a kernel that supports inotify_watch (CONFIG_INOTIFY) which is found in kernels 2.6.13+ and CentOS/RHEL 5 by default. If you are running CentOS 4 you should consider an inbox upgrade with:Upgrade CentOS 4.8 to 5.x (32bit) | R-fx NetworksThere are three modes that the monitor can be executed with and they relate to what will be monitored, they are USERS|PATHS|FILES. e.g: maldet --monitor users e.g: maldet --monitor /root/monitor_paths e.g: maldet --monitor /home/mike,/home/ashtonThe options break down as follows:USERS: The users option will take the homedirs of all system users that are above inotify_minuid and monitor them. If inotify_webdir is set then the users webdir, if it exists, will only be monitored.PATHS: A comma spaced list of paths to monitorFILE: A line spaced file list of paths to monitorOnce you start maldet in monitor mode, it will preprocess the paths based on the option specified followed by starting the inotify process. The starting of the inotify process can be a time consuming task as it needs to setup a monitor hook for every file under the monitored paths. Although the startup process can impact the load temporarily, once the process has started it maintains all ofits resources inside kernel memory and has a very small userspace footprint in memory or cpu usage.See http://www.rfxn.com/appdocs/README.maldetect for more details on inotify monitoring.https://www.rfxn.com/projects/linux-malware-detect/ Quote
