After running a while the default routing failed on vyos 1.4 epa1&epa2 with pppoe0 enabled
Open, HighPublicBUG
Actions

Assigned To

Authored By

	dongjunbo
	Mar 19 2024, 10:43 AM

Description

After running a while the default routing failed on vyos 1.4 epa1&epa2
https://forum.vyos.io/t/after-running-a-while-the-default-routing-failed-on-vyos-1-4-epa1/14062

Hi team,
After upgrade vyos 1.3.6 to vyos 1.4.0 epa 1 . The network of all computers in LAN is fine. But on vyos router , the default routing is broken. Plus the performance is slower than vyos 1.3 at the same hardware and configuration.

gw-192-168-11-1:~$ ping 1.1.1.1
/bin/ping: connect: Network is unreachable
Here is the configuration:

shell
set interfaces bridge br0 address 'xxx.xxx.100.1/24'
set interfaces bridge br0 member interface eth0
set interfaces bridge br0 member interface eth1
set interfaces bridge br0 member interface eth3
set interfaces bridge br0 member interface eth4
set interfaces ethernet eth0 hw-id 'xx:xx:xx:xx:xx:9c'
set interfaces ethernet eth1 duplex 'auto'
set interfaces ethernet eth1 hw-id 'xx:xx:xx:xx:xx:9d'
set interfaces ethernet eth1 offload gro
set interfaces ethernet eth1 offload gso
set interfaces ethernet eth1 offload sg
set interfaces ethernet eth1 offload tso
set interfaces ethernet eth1 speed 'auto'
set interfaces ethernet eth2 address 'dhcp'
set interfaces ethernet eth2 description 'WAN1'
set interfaces ethernet eth2 duplex 'auto'
set interfaces ethernet eth2 hw-id 'xx:xx:xx:xx:xx:9e'
set interfaces ethernet eth2 offload gro
set interfaces ethernet eth2 offload gso
set interfaces ethernet eth2 offload sg
set interfaces ethernet eth2 offload tso
set interfaces ethernet eth2 speed 'auto'
set interfaces ethernet eth3 duplex 'auto'
set interfaces ethernet eth3 hw-id 'xx:xx:xx:xx:xx:9f'
set interfaces ethernet eth3 offload gro
set interfaces ethernet eth3 offload gso
set interfaces ethernet eth3 offload sg
set interfaces ethernet eth3 offload tso
set interfaces ethernet eth3 speed 'auto'
set interfaces ethernet eth4 duplex 'auto'
set interfaces ethernet eth4 hw-id 'xx:xx:xx:xx:xx:a0'
set interfaces ethernet eth4 offload gro
set interfaces ethernet eth4 offload gso
set interfaces ethernet eth4 offload sg
set interfaces ethernet eth4 offload tso
set interfaces ethernet eth4 speed 'auto'
set interfaces ethernet eth5 address 'xxx.xxx.0.100/24'
set interfaces ethernet eth5 duplex 'auto'
set interfaces ethernet eth5 hw-id 'xx:xx:xx:xx:xx:a1'
set interfaces ethernet eth5 offload gro
set interfaces ethernet eth5 offload gso
set interfaces ethernet eth5 offload sg
set interfaces ethernet eth5 offload tso
set interfaces ethernet eth5 speed 'auto'
set interfaces loopback lo address 'xxx.xxx.16.16/32'
set interfaces pppoe pppoe0 authentication password xxxxxx
set interfaces pppoe pppoe0 authentication username xxxxxx
set interfaces pppoe pppoe0 dhcpv6-options pd 0 interface eth0 address '1'
set interfaces pppoe pppoe0 dhcpv6-options pd 0 interface eth0 sla-id '0'
set interfaces pppoe pppoe0 dhcpv6-options pd 0 length '64'
set interfaces pppoe pppoe0 ipv6 address autoconf
set interfaces pppoe pppoe0 mtu '1492'
set interfaces pppoe pppoe0 no-peer-dns
set interfaces pppoe pppoe0 source-interface 'eth2'
set nat source rule 100 outbound-interface name 'pppoe0'
set nat source rule 100 translation address 'masquerade'
set protocols static route xxx.xxx.0.0/0 interface pppoe0
set protocols static route xxx.xxx.1.0/24 next-hop xxx.xxx.100.2
set protocols static route xxx.xxx.151.0/24 interface wg01
set protocols static route xxx.xxx.3.0/24 next-hop xxx.xxx.100.2
set protocols static route xxx.xxx.11.0/24 interface wg01
set service dhcp-server host-decl-name
set service dhcp-server hostfile-update
set service dhcp-server listen-address 'xxx.xxx.100.1'
set service dhcp-server shared-network-name xxxxxx description 'GW-LAN'
set service dhcp-server shared-network-name xxxxxx domain-name xxxxxx
set service dhcp-server shared-network-name xxxxxx domain-search xxxxxx
set service dhcp-server shared-network-name xxxxxx name-server 'xxx.xxx.19.40'
set service dhcp-server shared-network-name xxxxxx name-server 'xxx.xxx.19.50'
set service dhcp-server shared-network-name xxxxxx subnet xxx.xxx.100.0/24 default-router 'xxx.xxx.100.1'
set service dhcp-server shared-network-name xxxxxx subnet xxx.xxx.100.0/24 range 0 start 'xxx.xxx.100.50'
set service dhcp-server shared-network-name xxxxxx subnet xxx.xxx.100.0/24 range 0 stop 'xxx.xxx.100.254'
set service dhcp-server shared-network-name xxxxxx description 'lan'
set service dhcp-server shared-network-name xxxxxx domain-name xxxxxx
set service dhcp-server shared-network-name xxxxxx domain-search xxxxxx
set service dhcp-server shared-network-name xxxxxx name-server 'xxx.xxx.100.1'
set service dhcp-server shared-network-name xxxxxx subnet xxx.xxx.3.0/24 default-router 'xxx.xxx.3.1'
set service dhcp-server shared-network-name xxxxxx subnet xxx.xxx.3.0/24 name-server 'xxx.xxx.19.40'
set service dhcp-server shared-network-name xxxxxx subnet xxx.xxx.3.0/24 name-server 'xxx.xxx.19.50'
set service dhcp-server shared-network-name xxxxxx subnet xxx.xxx.3.0/24 range 0 start 'xxx.xxx.3.10'
set service dhcp-server shared-network-name xxxxxx subnet xxx.xxx.3.0/24 range 0 stop 'xxx.xxx.3.254'
set service dhcp-server shared-network-name xxxxxx description 'wifi'
set service dhcp-server shared-network-name xxxxxx domain-name xxxxxx
set service dhcp-server shared-network-name xxxxxx domain-search xxxxxx
set service dhcp-server shared-network-name xxxxxx name-server 'xxx.xxx.100.1'
set service dhcp-server shared-network-name xxxxxx subnet xxx.xxx.1.0/24 default-router 'xxx.xxx.1.1'
set service dhcp-server shared-network-name xxxxxx subnet xxx.xxx.1.0/24 name-server 'xxx.xxx.19.40'
set service dhcp-server shared-network-name xxxxxx subnet xxx.xxx.1.0/24 name-server 'xxx.xxx.19.50'
set service dhcp-server shared-network-name xxxxxx subnet xxx.xxx.1.0/24 range 0 start 'xxx.xxx.1.10'
set service dhcp-server shared-network-name xxxxxx subnet xxx.xxx.1.0/24 range 0 stop 'xxx.xxx.1.254'
set service dns dynamic name service-cloudflare-pppoe0 address interface 'pppoe0'
set service dns dynamic name service-cloudflare-pppoe0 host-name xxxxxx
set service dns dynamic name service-cloudflare-pppoe0 password xxxxxx
set service dns dynamic name service-cloudflare-pppoe0 protocol 'cloudflare'
set service dns dynamic name service-cloudflare-pppoe0 username xxxxxx
set service dns dynamic name service-cloudflare-pppoe0 zone 'xxx.xxx'
set service dns dynamic name service-dyndns-pppoe0 address interface 'pppoe0'
set service dns dynamic name service-dyndns-pppoe0 host-name xxxxxx
set service dns dynamic name service-dyndns-pppoe0 password xxxxxx
set service dns dynamic name service-dyndns-pppoe0 protocol 'dyndns2'
set service dns dynamic name service-dyndns-pppoe0 server 'dyn.dns.he.net'
set service dns dynamic name service-dyndns-pppoe0 username xxxxxx
set service dns forwarding allow-from 'xxx.xxx.0.0/0'
set service dns forwarding cache-size '10000'
set service dns forwarding listen-address 'xxx.xxx.100.1'
set service dns forwarding name-server xxx.xxx.1.4
set service dns forwarding name-server xxx.xxx.114.114
set service dns forwarding name-server xxx.xxx.29.29
set service dns forwarding name-server xxx.xxx.19.50
set service https
set service lldp interface all
set service lldp interface eth0
set service ntp allow-client xxxxxx 'xxx.xxx.0.0/0'
set service ntp allow-client xxxxxx '::/0'
set service ntp server xxxxx.tld
set service ntp server xxxxx.tld
set service ntp server xxxxx.tld
set service router-advert interface eth0 default-lifetime '300'
set service router-advert interface eth0 default-preference 'high'
set service router-advert interface eth0 hop-limit '64'
set service router-advert interface eth0 interval max '30'
set service router-advert interface eth0 link-mtu '1452'
set service router-advert interface eth0 other-config-flag
set service router-advert interface eth0 prefix ::/64 preferred-lifetime '300'
set service router-advert interface eth0 prefix ::/64 valid-lifetime '172800'
set service router-advert interface eth0 reachable-time '900000'
set service router-advert interface eth0 retrans-timer '0'
set service snmp community OkayWorld authorization 'ro'
set service ssh disable-host-validation
set service ssh dynamic-protection
set service ssh port '9528'
set system config-management commit-revisions '100'
set system conntrack modules ftp
set system conntrack modules h323
set system conntrack modules nfs
set system conntrack modules pptp
set system conntrack modules sip
set system conntrack modules sqlnet
set system conntrack modules tftp
set system console device ttyS0 speed '9600'
set system host-name xxxxxx
set system login banner post-login '\n\n\tWelcome back!\n\n\n'
set system login banner pre-login '\n\n\tUNAUTHORIZED USE OF THIS SYSTEM IS PROHIBITED!\n\n\n'
set system login user xxxxxx authentication encrypted-password xxxxxx
set system login user xxxxxx authentication plaintext-password xxxxxx
set system login user xxxxxx authentication encrypted-password xxxxxx
set system login user xxxxxx authentication plaintext-password xxxxxx
set system name-server 'xxx.xxx.114.114'
set system syslog global facility all level 'info'
set system syslog global facility local7 level 'debug'
set system task-scheduler task RUN_TASKS_EVERY_MINUTE executable path '/config/scripts/run_tasks_every_minute.sh'
set system task-scheduler task RUN_TASKS_EVERY_MINUTE interval '1m'
set system task-scheduler task daily-reboot crontab-spec '0 5 * * *'
set system task-scheduler task daily-reboot executable path '/sbin/reboot'
set system time-zone 'Asia/Tokyo'

and system version

~$ show version
Version:          VyOS 1.4.0-epa2
Release train:    sagitta

Built by:         Sentrium S.L.
Built on:         Tue 12 Mar 2024 11:58 UTC
Build UUID:       7b60be54-0b8f-4337-aa9e-b6e675942946
Build commit ID:  48f7d41a607707

Architecture:     x86_64
Boot via:         installed image
System type:      bare metal

Hardware vendor:  Default string
Hardware model:   Default string
Hardware S/N:     Default string
Hardware UUID:    03000200-0400-0500-0006-000700080009

Copyright:        VyOS maintainers and contributors

Details

Version: -
Is it a breaking change?: Perfectly compatible
Issue type: Bug (incorrect behavior)

Event Timeline

dongjunbo created this task.Mar 19 2024, 10:43 AM

dongjunbo triaged this task as High priority.

dongjunbo created this object in space S1 VyOS Public.

dongjunbo updated the task description. (Show Details)Mar 19 2024, 10:45 AM

Show this commands output if that happens:

show interfaces pppoe pppoe0
show ip route
show log pppoe

Show performance test results from versions 1.3 and 1.4

The Root Cause is this 'Static routes not working with PPPoE and VyOS 1.4'
https://forum.vyos.io/t/static-routes-not-working-with-pppoe-and-vyos-1-4/14102

dongjunbo renamed this task from After running a while the default routing failed on vyos 1.4 epa1 with pppoe0 enabled to After running a while the default routing failed on vyos 1.4 epa1&epa2 with pppoe0 enabled.Mar 21 2024, 12:31 AM

dongjunbo updated the task description. (Show Details)

Does the problem only appear after your 5am reboot every day?

In T6140#180451, @dongjunbo wrote:

The Root Cause is this 'Static routes not working with PPPoE and VyOS 1.4'
https://forum.vyos.io/t/static-routes-not-working-with-pppoe-and-vyos-1-4/14102

I

No, it is not your case.
I tested both configuration and yours working fine.

pasik subscribed.Mar 21 2024, 3:57 PM

In T6140#180242, @pepe wrote:
Show this commands output if that happens:
show interfaces pppoe pppoe0
show ip route
show log pppoe
Show performance test results from versions 1.3 and 1.4

I recreate a vyos lab router to reproduct it again.



1. Configuration

```bash
myadmin@vyos-1:/config/scripts$ show configuration commands | strip-private
set interfaces ethernet eth0 address 'xxx.xxx.111.12/24'
set interfaces ethernet eth0 hw-id 'xx:xx:xx:xx:xx:8c'
set interfaces ethernet eth0 mtu '1500'
set interfaces ethernet eth1 address 'xxx.xxx.19.1/24'
set interfaces loopback lo
set interfaces pppoe pppoe0 authentication password xxxxxx
set interfaces pppoe pppoe0 authentication username xxxxxx
set interfaces pppoe pppoe0 default-route-distance '255'
set interfaces pppoe pppoe0 dhcpv6-options
set interfaces pppoe pppoe0 ipv6 address autoconf
set interfaces pppoe pppoe0 mru '1480'
set interfaces pppoe pppoe0 mtu '1492'
set interfaces pppoe pppoe0 no-peer-dns
set interfaces pppoe pppoe0 source-interface 'eth0'
set nat source rule 100 outbound-interface name 'pppoe0'
set nat source rule 100 translation address 'masquerade'
set protocols static route xxx.xxx.0.0/0 interface pppoe0
set service ntp allow-client xxxxxx 'xxx.xxx.0.0/0'
set service ntp allow-client xxxxxx '::/0'
set service ntp server xxxxx.tld
set service ntp server xxxxx.tld
set service ntp server xxxxx.tld
set service ntp server xxxxx.tld
set service ssh client-keepalive-interval '180'
set service ssh listen-address 'xxx.xxx.0.0'
set service ssh port '9528'
set system config-management commit-revisions '100'
set system conntrack modules ftp
set system conntrack modules h323
set system conntrack modules nfs
set system conntrack modules pptp
set system conntrack modules sip
set system conntrack modules sqlnet
set system conntrack modules tftp
set system domain-name xxxxxx
set system domain-search xxxxxx
set system domain-search xxxxxx
set system host-name xxxxxx
set system login banner post-login "welcome"
set system login banner pre-login "Welcom back"
set system login user xxxxxx authentication encrypted-password xxxxxx
set system login user xxxxxx authentication public-keys xxxx@xxx.xxx key xxxxxx
set system login user xxxxxx authentication public-keys xxxx@xxx.xxx type ssh-xxx
set system login user xxxxxx authentication encrypted-password xxxxxx
set system login user xxxxxx authentication public-keys xxxx@xxx.xxx key xxxxxx
set system login user xxxxxx authentication public-keys xxxx@xxx.xxx type ssh-xxx
set system login user xxxxxx authentication encrypted-password xxxxxx
set system login user xxxxxx authentication plaintext-password xxxxxx
set system name-server 'xxx.xxx.xxx.xxx'
set system name-server 'xxx.xxx.xxx.xxx'
set system syslog global facility all level 'notice'
set system syslog global facility local7 level 'debug'
set system time-zone 'Asia/Tokyo'

show ip route

myadmin@vyos-1:/config/scripts$ show ip route  | strip-private
Codes: K - kernel route, C - connected, S - static, R - RIP,
       O - OSPF, I - IS-IS, B - BGP, E - EIGRP, N - NHRP,
       T - Table, v - VNC, V - VNC-Direct, A - Babel, F - PBR,
       f - OpenFabric,
       > - selected route, * - FIB route, q - queued, r - rejected, b - backup
       t - trapped, o - offload failure

S   xxx.xxx.0.0/0 [255/0] is directly connected, pppoe0, weight 1, 00:04:44
C>* xxx.xxx.66.1/32 is directly connected, pppoe0, 00:04:45
C>* xxx.xxx.19.0/24 is directly connected, eth1, 04:12:36
C>* xxx.xxx.111.0/24 is directly connected, eth0, 04:11:34

show log pppoe interface pppoe0

myadmin@vyos-1:/config/scripts$ show log pppoe interface pppoe0  | strip-private
Mar 22 07:13:21 systemd[1]: Started ppp@pppoe0.service - Dialing PPP connection pppoe0.
Mar 22 07:13:21 pppd[4189]: Plugin rp-pppoe.so loaded.
Mar 22 07:13:21 pppd[4189]: Plugin rp-pppoe.so loaded.
Mar 22 07:13:21 pppd[4189]: pppd 2.4.9 started by root, uid 0
Mar 22 07:13:21 pppd[4189]: Send PPPOE Discovery V1T1 PADI session 0x0 length 12
Mar 22 07:13:21 pppd[4189]:  dst xx:xx:xx:xx:xx:ff  src xx:xx:xx:xx:xx:8c
Mar 22 07:13:21 pppd[4189]:  [service-name] [host-uniq  5d 10 00 00]
Mar 22 07:13:21 pppd[4189]: Recv PPPOE Discovery V1T1 PADO session 0x0 length 40
Mar 22 07:13:21 pppd[4189]:  dst xx:xx:xx:xx:xx:8c  src xx:xx:xx:xx:xx:55
Mar 22 07:13:21 pppd[4189]:  [service-name] [host-uniq  5d 10 00 00] [AC-name xxx.MAN.NE40E]
Mar 22 07:13:21 pppd[4189]: Send PPPOE Discovery V1T1 PADR session 0x0 length 12
Mar 22 07:13:21 pppd[4189]:  dst xx:xx:xx:xx:xx:55  src xx:xx:xx:xx:xx:8c
Mar 22 07:13:21 pppd[4189]:  [service-name] [host-uniq  5d 10 00 00]
Mar 22 07:13:21 pppd[4189]: Recv PPPOE Discovery V1T1 PADS session 0x553c length 12
Mar 22 07:13:21 pppd[4189]:  dst xx:xx:xx:xx:xx:8c  src xx:xx:xx:xx:xx:55
Mar 22 07:13:21 pppd[4189]:  [service-name] [host-uniq  5d 10 00 00]
Mar 22 07:13:21 pppd[4189]: PADS: Service-Name: ''
Mar 22 07:13:21 pppd[4189]: PPP session is 21820
Mar 22 07:13:21 pppd[4189]: Connected to xx:xx:xx:xx:xx:55 via interface eth0
Mar 22 07:13:21 pppd[4189]: using channel 1
Mar 22 07:13:21 pppd[4189]: Renamed interface ppp0 to pppoe0
Mar 22 07:13:21 pppd[4189]: Using interface pppoe0
Mar 22 07:13:21 pppd[4189]: Connect: pppoe0 <--> eth0
Mar 22 07:13:21 pppd[4189]: sent [LCP ConfReq id=0x1 <mru 1480> <magic 0x448065e5>]
Mar 22 07:13:21 pppd[4189]: rcvd [LCP ConfAck id=0x1 <mru 1480> <magic 0x448065e5>]
Mar 22 07:13:24 pppd[4189]: rcvd [LCP ConfReq id=0x2 <mru 1492> <auth chap MD5> <magic 0xe3f3b528>]
Mar 22 07:13:24 pppd[4189]: sent [LCP ConfAck id=0x2 <mru 1492> <auth chap MD5> <magic 0xe3f3b528>]
Mar 22 07:13:24 pppd[4189]: sent [LCP EchoReq id=0x0 magic=0x448065e5]
Mar 22 07:13:24 pppd[4189]: rcvd [CHAP Challenge id=0x1 <305514cd92caa55e5d5454e27ea718ac>, name = "xxxx"]
Mar 22 07:13:24 pppd[4189]: sent [CHAP Response id=0x1 <1a6a900003383d85ce43f7e883201fad>, name = "xxxxxx"]
Mar 22 07:13:24 pppd[4189]: rcvd [LCP EchoRep id=0x0 magic=0xe3f3b528]
Mar 22 07:13:24 pppd[4189]: rcvd [CHAP Success id=0x1 "Authentication success,Welcome!"]
Mar 22 07:13:24 pppd[4189]: CHAP authentication succeeded: Authentication success,Welcome!
Mar 22 07:13:24 pppd[4189]: CHAP authentication succeeded
Mar 22 07:13:24 pppd[4189]: peer from calling number xx:xx:xx:xx:xx:55 authorized
Mar 22 07:13:24 pppd[4189]: sent [IPCP ConfReq id=0x1 <addr xxx.xxx.0.0>]
Mar 22 07:13:24 pppd[4189]: sent [IPV6CP ConfReq id=0x1 <addr fe80::a88c:3650:e097:bcc0>]
Mar 22 07:13:24 pppd[4189]: rcvd [IPCP ConfReq id=0x1 <addr xxx.xxx.66.1>]
Mar 22 07:13:24 pppd[4189]: sent [IPCP ConfAck id=0x1 <addr xxx.xxx.66.1>]
Mar 22 07:13:24 pppd[4189]: rcvd [IPV6CP ConfReq id=0x1 <addr fe80::da49:0bff:feb5:b455>]
Mar 22 07:13:24 pppd[4189]: sent [IPV6CP ConfAck id=0x1 <addr fe80::da49:0bff:feb5:b455>]
Mar 22 07:13:24 pppd[4189]: rcvd [IPCP ConfNak id=0x1 <addr xxx.xxx.66.238>]
Mar 22 07:13:24 pppd[4189]: sent [IPCP ConfReq id=0x2 <addr xxx.xxx.66.238>]
Mar 22 07:13:24 pppd[4189]: rcvd [IPV6CP ConfAck id=0x1 <addr fe80::a88c:3650:e097:bcc0>]
Mar 22 07:13:24 pppd[4189]: local  LL address fe80::a88c:3650:e097:bcc0
Mar 22 07:13:24 pppd[4189]: remote LL address fe80::da49:0bff:feb5:b455
Mar 22 07:13:24 pppd[4189]: Script /etc/ppp/ipv6-up started (pid 4245)
Mar 22 07:13:24 pppd[4189]: rcvd [IPCP ConfAck id=0x2 <addr xxx.xxx.66.238>]
Mar 22 07:13:24 pppd[4189]: Script /etc/ppp/ip-pre-up started (pid 4246)
Mar 22 07:13:24 pppd[4189]: Script /etc/ppp/ip-pre-up finished (pid 4246), status = 0x0
Mar 22 07:13:24 pppd[4189]: local  IP address xxx.xxx.66.238
Mar 22 07:13:24 pppd[4189]: remote IP address xxx.xxx.66.1
Mar 22 07:13:24 pppd[4189]: Script /etc/ppp/ip-up started (pid 4250)
Mar 22 07:13:24 pppd[4189]: Script /etc/ppp/ipv6-up finished (pid 4245), status = 0x0
Mar 22 07:13:25 sudo[4270]:     root : PWD=/ ; USER=root ; COMMAND=/usr/sbin/dmidecode -t 4
Mar 22 07:13:25 sudo[4270]: pam_unix(sudo:session): session opened for user xxxxxx by (uid=0)
Mar 22 07:13:25 sudo[4270]: pam_unix(sudo:session): session closed for user xxxxxx
Mar 22 07:13:26 sudo[4344]:     root : PWD=/ ; USER=root ; COMMAND=/usr/sbin/dmidecode -t 4
Mar 22 07:13:26 sudo[4344]: pam_unix(sudo:session): session opened for user xxxxxx by (uid=0)
Mar 22 07:13:26 sudo[4344]: pam_unix(sudo:session): session closed for user xxxxxx
Mar 22 07:13:26 pppd[4189]: Script /etc/ppp/ip-up finished (pid 4250), status = 0x0
Mar 22 11:17:25 pppd[4189]: Terminating on signal 15
Mar 22 11:17:25 pppd[4189]: Connect time 244.1 minutes.
Mar 22 11:17:25 systemd[1]: Stopping ppp@pppoe0.service - Dialing PPP connection pppoe0...
Mar 22 11:17:25 pppd[4189]: Sent 417056 bytes, received 743348 bytes.
Mar 22 11:17:25 pppd[4189]: Script /etc/ppp/ip-down started (pid 11485)
Mar 22 11:17:25 pppd[4189]: Script /etc/ppp/ipv6-down started (pid 11486)
Mar 22 11:17:25 pppd[4189]: sent [LCP TermReq id=0x2 "User request"]
Mar 22 11:17:25 pppd[4189]: rcvd [LCP TermAck id=0x2]
Mar 22 11:17:25 pppd[4189]: Connection terminated.
Mar 22 11:17:25 pppd[4189]: Connect time 244.1 minutes.
Mar 22 11:17:25 pppd[4189]: Sent 417056 bytes, received 743348 bytes.
Mar 22 11:17:25 pppd[4189]: Script /etc/ppp/ipv6-down finished (pid 11486), status = 0x0
Mar 22 11:17:25 pppd[4189]: Waiting for 1 child processes...
Mar 22 11:17:25 pppd[4189]:   script /etc/ppp/ip-down, pid 11485
Mar 22 11:17:26 pppd[4189]: Script /etc/ppp/ip-down finished (pid 11485), status = 0x0
Mar 22 11:17:26 pppd[4189]: Exit.
Mar 22 11:17:26 systemd[1]: ppp@pppoe0.service: Main process exited, code=exited, status=5/NOTINSTALLED
Mar 22 11:17:26 systemd[1]: ppp@pppoe0.service: Failed with result 'exit-code'.
Mar 22 11:17:26 systemd[1]: Stopped ppp@pppoe0.service - Dialing PPP connection pppoe0.
Mar 22 11:17:26 systemd[1]: ppp@pppoe0.service: Consumed 2.057s CPU time.
Mar 22 11:17:36 systemd[1]: Started ppp@pppoe0.service - Dialing PPP connection pppoe0.
Mar 22 11:17:36 pppd[11638]: Plugin rp-pppoe.so loaded.
Mar 22 11:17:36 pppd[11638]: Plugin rp-pppoe.so loaded.
Mar 22 11:17:36 pppd[11638]: pppd 2.4.9 started by root, uid 0
Mar 22 11:17:36 pppd[11638]: Send PPPOE Discovery V1T1 PADI session 0x0 length 12
Mar 22 11:17:36 pppd[11638]:  dst xx:xx:xx:xx:xx:ff  src xx:xx:xx:xx:xx:8c
Mar 22 11:17:36 pppd[11638]:  [service-name] [host-uniq  76 2d 00 00]
Mar 22 11:17:36 pppd[11638]: Recv PPPOE Discovery V1T1 PADO session 0x0 length 40
Mar 22 11:17:36 pppd[11638]:  dst xx:xx:xx:xx:xx:8c  src xx:xx:xx:xx:xx:55
Mar 22 11:17:36 pppd[11638]:  [service-name] [host-uniq  76 2d 00 00] [AC-name xxx.MAN.NE40E]
Mar 22 11:17:36 pppd[11638]: Send PPPOE Discovery V1T1 PADR session 0x0 length 12
Mar 22 11:17:36 pppd[11638]:  dst xx:xx:xx:xx:xx:55  src xx:xx:xx:xx:xx:8c
Mar 22 11:17:36 pppd[11638]:  [service-name] [host-uniq  76 2d 00 00]
Mar 22 11:17:36 pppd[11638]: Recv PPPOE Discovery V1T1 PADS session 0x357e length 12
Mar 22 11:17:36 pppd[11638]:  dst xx:xx:xx:xx:xx:8c  src xx:xx:xx:xx:xx:55
Mar 22 11:17:36 pppd[11638]:  [service-name] [host-uniq  76 2d 00 00]
Mar 22 11:17:36 pppd[11638]: PADS: Service-Name: ''
Mar 22 11:17:36 pppd[11638]: PPP session is 13694
Mar 22 11:17:36 pppd[11638]: Connected to xx:xx:xx:xx:xx:55 via interface eth0
Mar 22 11:17:36 pppd[11638]: using channel 2
Mar 22 11:17:36 pppd[11638]: Renamed interface ppp0 to pppoe0
Mar 22 11:17:36 pppd[11638]: Using interface pppoe0
Mar 22 11:17:36 pppd[11638]: Connect: pppoe0 <--> eth0
Mar 22 11:17:36 pppd[11638]: sent [LCP ConfReq id=0x1 <mru 1480> <magic 0x5798d3c3>]
Mar 22 11:17:36 pppd[11638]: rcvd [LCP ConfAck id=0x1 <mru 1480> <magic 0x5798d3c3>]
Mar 22 11:17:39 pppd[11638]: rcvd [LCP ConfReq id=0x2 <mru 1492> <auth chap MD5> <magic 0x849a4c18>]
Mar 22 11:17:39 pppd[11638]: sent [LCP ConfAck id=0x2 <mru 1492> <auth chap MD5> <magic 0x849a4c18>]
Mar 22 11:17:39 pppd[11638]: sent [LCP EchoReq id=0x0 magic=0x5798d3c3]
Mar 22 11:17:39 pppd[11638]: rcvd [CHAP Challenge id=0x1 <d14948d50104ad828dd34b5a9886dcf5>, name = "xxx"]
Mar 22 11:17:39 pppd[11638]: sent [CHAP Response id=0x1 <7930f8b0c0c7dfe2916a8fe3658f1c1c>, name = "xxxxx"]
Mar 22 11:17:39 pppd[11638]: rcvd [LCP EchoRep id=0x0 magic=0x849a4c18]
Mar 22 11:17:39 pppd[11638]: rcvd [CHAP Success id=0x1 "Authentication success,Welcome!"]
Mar 22 11:17:39 pppd[11638]: CHAP authentication succeeded: Authentication success,Welcome!
Mar 22 11:17:39 pppd[11638]: CHAP authentication succeeded
Mar 22 11:17:39 pppd[11638]: peer from calling number xx:xx:xx:xx:xx:55 authorized
Mar 22 11:17:39 pppd[11638]: sent [IPCP ConfReq id=0x1 <addr xxx.xxx.0.0>]
Mar 22 11:17:39 pppd[11638]: sent [IPV6CP ConfReq id=0x1 <addr fe80::2cc8:fa30:ee53:4cd5>]
Mar 22 11:17:39 pppd[11638]: rcvd [IPCP ConfReq id=0x1 <addr xxx.xxx.66.1>]
Mar 22 11:17:39 pppd[11638]: sent [IPCP ConfAck id=0x1 <addr xxx.xxx.66.1>]
Mar 22 11:17:39 pppd[11638]: rcvd [IPV6CP ConfReq id=0x1 <addr fe80::da49:0bff:feb5:b455>]
Mar 22 11:17:39 pppd[11638]: sent [IPV6CP ConfAck id=0x1 <addr fe80::da49:0bff:feb5:b455>]
Mar 22 11:17:39 pppd[11638]: rcvd [IPCP ConfNak id=0x1 <addr xxx.xxx.66.106>]
Mar 22 11:17:39 pppd[11638]: sent [IPCP ConfReq id=0x2 <addr xxx.xxx.66.106>]
Mar 22 11:17:39 pppd[11638]: rcvd [IPV6CP ConfAck id=0x1 <addr fe80::2cc8:fa30:ee53:4cd5>]
Mar 22 11:17:39 pppd[11638]: local  LL address fe80::2cc8:fa30:ee53:4cd5
Mar 22 11:17:39 pppd[11638]: remote LL address fe80::da49:0bff:feb5:b455
Mar 22 11:17:39 pppd[11638]: Script /etc/ppp/ipv6-up started (pid 11650)
Mar 22 11:17:39 pppd[11638]: rcvd [IPCP ConfAck id=0x2 <addr xxx.xxx.66.106>]
Mar 22 11:17:39 pppd[11638]: Script /etc/ppp/ip-pre-up started (pid 11651)
Mar 22 11:17:39 pppd[11638]: Script /etc/ppp/ip-pre-up finished (pid 11651), status = 0x0
Mar 22 11:17:39 pppd[11638]: local  IP address xxx.xxx.66.106
Mar 22 11:17:39 pppd[11638]: remote IP address xxx.xxx.66.1
Mar 22 11:17:39 pppd[11638]: Script /etc/ppp/ip-up started (pid 11655)
Mar 22 11:17:39 pppd[11638]: Script /etc/ppp/ipv6-up finished (pid 11650), status = 0x0
Mar 22 11:17:40 sudo[11675]:     root : PWD=/ ; USER=root ; COMMAND=/usr/sbin/dmidecode -t 4
Mar 22 11:17:40 sudo[11675]: pam_unix(sudo:session): session opened for user xxxxxx by (uid=0)
Mar 22 11:17:40 sudo[11675]: pam_unix(sudo:session): session closed for user xxxxxx
Mar 22 11:17:41 sudo[11714]:     root : PWD=/ ; USER=root ; COMMAND=/usr/sbin/dmidecode -t 4
Mar 22 11:17:41 sudo[11714]: pam_unix(sudo:session): session opened for user xxxxxx by (uid=0)
Mar 22 11:17:41 sudo[11714]: pam_unix(sudo:session): session closed for user xxxxxx
Mar 22 11:17:41 pppd[11638]: Script /etc/ppp/ip-up finished (pid 11655), status = 0x0

When I manually disconnect pppoe0 and reconnect pppoe0 . this error will appear

myadmin@vyos-1:/config/scripts$ ping 1.1.1.1
/bin/ping: connect: Network is unreachable
myadmin@vyos-1:/config/scripts$

Also since dynamic and not static IP is being used it would be handy if the DHCP exchange can be captured using tcpdump and do this both on the 1.3 where this works and on 1.4/1.5 where this doesnt work.

This way we can find out what the difference is in the request flow (from the client) but also in the response flow (from the server) - in case DHCP would be to be blamed on this behaviour.

In T6140#180604, @Apachez wrote:

Also since dynamic and not static IP is being used it would be handy if the DHCP exchange can be captured using tcpdump and do this both on the 1.3 where this works and on 1.4/1.5 where this doesnt work.

This way we can find out what the difference is in the request flow (from the client) but also in the response flow (from the server) - in case DHCP would be to be blamed on this behaviour.

I didn't enable dhcp setttings. Check The last post. I set the static ip address on eth0 which binding pppoe interface.

Wouldnt PPPoE always assign IP dynamically?

As described by:

https://community.ui.com/questions/How-to-configure-a-static-IP-address-for-PPPoE-WAN/2e8acd8d-5e00-418f-b550-00aeeef08142

If you truly have a PPPoE account then you would not specify your external IP.  Doing so shuts down the connection since the whole point of PPPoE is connecting to an account and receiving your IP's dynamically.  I think that's where the train falls off the track.  You should have a /32 IP assigned by the ISP and in your case they are routing transparently through the /32 a /30 block (since i couldn't get to your config I am concluding this).  So you would set the WAN on - let's say eth1 - and choose PPPoE, enter your login credentials, and allow it to connect.  This is a lot easier if you use the wizard.  

You should see a WAN PPPoE on eth1 on the interfaces window with NO IP assigned, however there will be a pppoe0 interface with the ISP assigned /32 address.  Do not enter this address anywhere else on the ER.

In my case I am using 2 LAN's - a Public LAN and a Private LAN.  The interface of the public LAN has the first available IP in the /29 block (or in your case the /30).  An external switch is connected to this port and I have devices that are dynamically assigned IP's in the public range.  I have a DHCP server set for this LAN.

I have a Private LAN that uses the 10.10.10.0/24 (anything in the private IP space can be used).  There also a switch that is connected to that LAN for all my private devices.  I also have a DHCP server set for this LAN.

The only change that you might want to make would be to put all your public machines in the private space and setup static mapping - (called 1-to-1 NAT) so that those devices can be reached from the internet for certain services.

Having said all that - I haven't studied PPPoE accounts outside the USA but this is the proper way to setup a PPPoE network with Static IP's.

I hope this helps.

and:

Just a heads up that in the states on ATT you can do full bridge or half bridge with PPPoE.  Full bridge means that your router hands off the username/password and does all the static routing.  Half bridge means the DSL modem has the username and password and just hands the heavy lifting on the static stuff to the firewall.... just ran into this today.

You can see this behaviour in your logs from 22 mar displaying what IP your ISP have assigned for your connection and that this is different between each reconnection of pppoe:

Mar 22 07:13:24 pppd[4189]: local  IP address xxx.xxx.66.238
Mar 22 07:13:24 pppd[4189]: remote IP address xxx.xxx.66.1
...
Mar 22 11:17:39 pppd[11638]: local  IP address xxx.xxx.66.106
Mar 22 11:17:39 pppd[11638]: remote IP address xxx.xxx.66.1

If you got an IP statically assigned by your ISP you will define this as a local-address in VyOS:

https://docs.vyos.io/en/latest/configuration/interfaces/pppoe.html#cfgcmd-set-interfaces-pppoe-interface-local-address-address

And then either use routing (static or dynamic) if the ISP assigned additional IP-range for you to be used or simply just setup a masquerade NAT-rule to source-nat into pppoe for all egress traffic and setup destination-nat for inbound traffic designed a specific internal server or client (like portforwarding incoming TCP80 and TCP443 to a dedicated webserver in dmz).

set interfaces pppoe pppoe0 default-route-distance '255'

You set route distance to 255 which means "Unreachable or Unknown Routes".

Remove it.

marc_s subscribed.Mar 22 2024, 1:16 PM

And remove set protocols static route xxx.xxx.0.0/0 interface pppoe0 unless you use set interfaces pppoe pppoe0 no-default-route.

But then you will have this problem: https://forum.vyos.io/t/static-routes-not-working-with-pppoe-and-vyos-1-4/14102

syncer changed the subtype of this task from "Task" to "Bug".Apr 20 2024, 5:12 PM

syncer edited projects, added VyOS 1.4 Sagitta (1.4.0-GA); removed VyOS 1.4 Sagitta.May 7 2024, 8:02 AM

syncer assigned this task to Viacheslav.May 9 2024, 8:18 AM

dmbaturin edited projects, added VyOS 1.4 Sagitta (1.4.1); removed VyOS 1.4 Sagitta (1.4.0-GA).Jul 2 2024, 7:28 PM

dmbaturin added a project: Restricted Project.Sep 16 2024, 4:15 PM

dmbaturin changed Is it a breaking change? from Unspecified (possibly destroys the router) to Perfectly compatible.Oct 14 2024, 8:42 AM

dmbaturin changed Issue type from Unspecified (please specify) to Bug (incorrect behavior).

dmbaturin removed a project: Restricted Project.Oct 14 2024, 8:49 AM

vyosbot added a project: Bugs.Oct 14 2024, 11:32 AM

syncer edited projects, added VyOS Rolling; removed VyOS 1.4 Sagitta (1.4.1).Nov 1 2024, 2:47 PM

syncer moved this task from Need Triage to Backlog - Bug on the VyOS Rolling board.

syncer added a subscriber: Global Notifications.Nov 1 2024, 9:16 PM

After running a while the default routing failed on vyos 1.4 epa1&epa2 with pppoe0 enabledOpen, HighPublicBUGActions

Description

Details

Event Timeline

After running a while the default routing failed on vyos 1.4 epa1&epa2 with pppoe0 enabled
Open, HighPublicBUG
Actions