ClearOS Bug Tracker


View Issue Details Jump to Notes ] Issue History ] Print ]
IDProjectCategoryView StatusDate SubmittedLast Update
0009541ClearOSapp-attack-detector - Attack Detectorpublic2016-07-08 06:512019-02-23 15:45
ReporterNickH 
Assigned Totracker 
PrioritynormalSeverityminorReproducibilityalways
StatusclosedResolutionsuspended 
PlatformOSOS Version
Product Version7.2.0 
Target Version7.6.0 UpdatesFixed in Version 
Summary0009541: Restarting the firewall wipes all f2b chains and rules
DescriptionIf you install and start app-attack-detector all the usual fail2ban (f2b) iptables rules and chains are created. If you restart the firewall they all get deleted and not not recreated. This is a standard f2b issue. You need to drop a 10-f2b type of rule (perhaps with a higher number so it runs later) into /etc/clearos/firewall.d with the systemd equivalent of "service fail2ban reload" in it. This will recreate the rules and chains on each firewall restart.
Steps To ReproduceInstall and start app-attack-detector with some rules enabled.
Restart the firewall.
TagsNo tags attached.
Attached Files? file icon 90-attack-detector [^] (1,829 bytes) 2017-07-19 14:09 [Show Content]
? file icon clearos-sshd.conf [^] (271 bytes) 2017-07-19 14:09
? file icon clearos-sshd-ddos.conf [^] (281 bytes) 2017-07-19 14:09

- Relationships

-  Notes
(0003601)
NickH (developer)
2016-07-08 07:08

Actually the "service fail2ban reload" is not ideal as you don't want to reload it if you have it disabled but there is not a condrestart option so you'd need to do your own pidof test (or some other means) to check if it was running in the first place before reloading.
(0003631)
NickH (developer)
2016-07-09 07:07

If fail2ban is not running then doing a reload is safe as it does not start the process, but throws an error because it is not running.

pidof does not work, probably because it is a python process rather than a process in its own right.

The following works but would be better converted to systemd format:

[ -e /run/fail2ban/fail2ban.pid ] && service fail2ban reload
(0004051)
NickH (developer)
2016-10-20 07:18

I've just got 7.x up and running. Using the systemctl command:

systemctl reload fail2ban.service

in /etc/clearos/firewall.d/20-something does not work. The process just hangs. Appending a "&" allows it to work:

systemctl reload fail2ban.service &

I have not yet checked out a conditional command to see if fail2ban is already running. Really it should not be reloaded if it is not running.
(0005401)
NickH (developer)
2017-04-19 12:05
edited on: 2017-05-01 07:11

Please can this be escalated? To me it is more than a minor bug and it makes the app useless. In my VM, the firewall clearly restarts at least once during boot up so the app is immediately useless as its firewall chains are wiped during the boot up.

There is currently a job ticket, 553549, where app-attack-detector would really help - if it worked.

(0005471)
NickH (developer)
2017-05-01 07:13

In 7.x the following works in my /etc/clearos/firewall.d/30-fail2ban:
[ -e /var/run/fail2ban/fail2ban.pid ] && systemctl reload fail2ban.service &
(0005761)
NickH (developer)
2017-06-20 13:29

The fix for this was pushed to the Community quite a while back. Is it ready yet for Business?
(0005871)
NickH (developer)
2017-07-14 13:04

I notice this did go through to Business but the bug has not been updated.

I am not convinced about the bug fix. It only appears to work on the enabled jails in app-attack-detector and not on all enabled jails. This means that anyone running fail2ban conventionally will still need to restart/reload f2b to get the non-ClearOS jail firewall rules added. Can the script not be opened up to reload the firewall rules from all jails returned by the script line:

JAILS=`LANG=en_US fail2ban-client status | grep "Jail list" | sed -e 's/.*Jail list://' [^] -e 's/,//g'`
(0005881)
user2
2017-07-17 08:37

Thanks for the heads up. The fail2ban implementation was migrated over to the "ipset" way of doing things ( see 0014761 ) so this item should be resolved.

> I am not convinced about the bug fix. It only appears to work on the enabled jails in app-attack-detector and not on all enabled jails.

The script picks up on all enabled jails using "fail2ban-client status - that includes non-app rules as well. In principle, it should work on both ipset and iptables implementations in fail2ban.

I'll mark this issue as resolved for now, but feel free to change it back if you find an issue!
(0005931)
NickH (developer)
2017-07-18 13:27
edited on: 2017-07-18 23:51

Reopening for multiple issues but not all totally related to the bug.
1 - both /etc/fail2ban/jail.d/clearos-sshd-ddos.conf and /etc/fail2ban/jail.d/clearos-sshd.conf have a bug. In /etc/fail2ban/jail.d/clearos-sshd-ddos.conf, the line reading "iptables-ipset-proto6-allports[name=sshd-ddos][name=sshd]" should read "action = iptables-ipset-proto6-allports[name=sshd-ddos]". Note the addition of the "action =" and the removal of the duplicate key word. It is similar in the other jail.
2 - I was getting the case that enabling sshd-ddos through the webconfig also enabled sshd but it has stopped that for the moment. I'll see if I can get a reproducible test case.
3 - The script adds the firewall rules to the INPUT chains but does nothing about adding the banned IP's to f2b-XXX chains. This is only necessary for iptables type blocks (cyrus-imap, postfix-sasl and proftpd). Personally I would have thought it may be easier that for any jail not using ipset just to reload the jail. This is detected very early on in the script (ACTION=`fail2ban-client get $JAIL actions | tail -n 1`) so it would be easy to test for it and branch.

[edit]
... and I am not sure if the [name= keyword] is necessary in 1 above
[/edit]

(0005941)
NickH (developer)
2017-07-18 23:49

Elaborating on 1 above, you can see the line is not working as the jail is created with the jail's default iptables-multiport rule and an f2b-sshd/sshd-dos chain is also created in iptables.
I think (so untested) 2 was caused when I added the "action =" to the action line but there were still 2 [name = ] bits to the rule causing the wrong sshd jail to be created for the sshd-ddos rule which confused ClearOS. I am also pretty certain the [name =] bit is not needed at all and it then defaults to using the jail name. I'll try to test tonight.
(0005951)
NickH (developer)
2017-07-19 14:12

I cannot reproduce issue 0000002, but please find attached my fixes to the firewall script and the two jails. The [name = .....] is unnecessary.
(0005961)
NickH (developer)
2017-07-20 14:18

More comments. I've just done a fresh installation and the two files /etc/fail2ban/jail.d/clearos-sshd-ddos.conf and /etc/fail2ban/jail.d/clearos-sshd.conf have come in in a workable state i.e. correctly, with [name = ...]. This leads me to believe my two files became corrupted somewhere during the upgrade when ClearOS changed the rules over to ipset. Can we look at older systems which have been through the ssh upgrade cycle to see if any of them are wrong. They are not files I'd have fiddled with apart from disabling the rules. I've checked my backups from Jan '17 and the action line was not there at all so it must have come in from an update of some sort. If you want I can go through my weekly backups to pin down when it happened.
(0005981)
NickH (developer)
2017-07-21 10:55

More research.
Sometime prior to 27/05/2017 the two .conf files were updated correctly. They were wrong in my backup of 03/06/2017. Between these two dates, on 31/05/2017 app-ssh-server-core and app-ssh-server were updated to 2.3.23-1. on 03/06/2017 there are two new .conf.rpmnew files which are fine and the original .conf files go wrong. It looks like the culprit is the post install script in app-ssh-server-core-2.3.23-1.v7.noarch.rpm which executes /usr/clearos/apps/ssh_server/deploy/upgrade and this is clearly knocking out the "action =" and also leads to the [name=...] bit appearing twice.

Possible conclusion: any installation from prior to 31/05 will now have erroneous clearos-sshd-ddos.conf and clearos-sshd.conf files which will leave the jails using the iptables default actions. This should easily be correctable in another post-install script.
(0006301)
NickH (developer)
2017-08-15 13:02

In my solution, I'd avoid reloading the jails asynchronously (where I put an "&" after the jail reload rule). Deleting two firewalls in quick succession restart sthe firewall twice and the asynchronous jobs risk colliding. I potentially hit that as an issue or there is something else going on in f2b which caused the script to not find any jails at all.
(0009471)
dloper (administrator)
2019-02-23 15:45

Migrated to: https://gitlab.com/clearos/clearfoundation/app-attack-detector/issues/2 [^]

- Issue History
Date Modified Username Field Change
2016-07-08 06:51 NickH New Issue
2016-07-08 07:08 NickH Note Added: 0003601
2016-07-09 07:07 NickH Note Added: 0003631
2016-08-17 09:47 user2 Status new => acknowledged
2016-10-20 07:18 NickH Note Added: 0004051
2017-04-19 12:05 NickH Note Added: 0005401
2017-05-01 07:12 NickH Note Edited: 0005401 View Revisions
2017-05-01 07:13 NickH Note Added: 0005471
2017-06-20 13:29 NickH Note Added: 0005761
2017-07-14 13:04 NickH Note Added: 0005871
2017-07-17 08:37 user2 Note Added: 0005881
2017-07-17 08:37 user2 Status acknowledged => resolved
2017-07-17 08:37 user2 Resolution open => fixed
2017-07-17 08:37 user2 Assigned To => user2
2017-07-18 12:26 user2 Target Version => 7.4.0 Beta 1
2017-07-18 13:27 NickH Note Added: 0005931
2017-07-18 13:27 NickH Status resolved => feedback
2017-07-18 13:27 NickH Resolution fixed => reopened
2017-07-18 13:29 NickH Note Edited: 0005931 View Revisions
2017-07-18 23:49 NickH Note Added: 0005941
2017-07-18 23:49 NickH Status feedback => assigned
2017-07-18 23:51 NickH Note Edited: 0005931 View Revisions
2017-07-19 14:09 NickH File Added: 90-attack-detector
2017-07-19 14:09 NickH File Added: clearos-sshd.conf
2017-07-19 14:09 NickH File Added: clearos-sshd-ddos.conf
2017-07-19 14:12 NickH Note Added: 0005951
2017-07-20 14:18 NickH Note Added: 0005961
2017-07-21 10:56 NickH Note Added: 0005981
2017-08-11 20:32 user2 Target Version 7.4.0 Beta 1 => 7.4.0 Updates
2017-08-15 13:02 NickH Note Added: 0006301
2018-04-11 10:27 user2 Target Version 7.4.0 Updates => 7.5.0 Updates
2018-10-30 18:11 user2 Target Version 7.5.0 Updates => 7.6.0 Updates
2018-12-14 12:10 user2 Assigned To user2 => tracker
2019-02-23 15:45 dloper Note Added: 0009471
2019-02-23 15:45 dloper Status assigned => closed
2019-02-23 15:45 dloper Resolution reopened => suspended