mailtraq not collecting pop3 completely

This is the Mailtraq Peer Support forum. Get assistance using and managing Mailtraq, and help others solve problems too.

mailtraq not collecting pop3 completely

Postby ukracer » Mon Sep 16th, 2013 6:32am

Mailtraq Version: 2.xx.x.xxxx

I cant seem to get mailtraq to complete the pop3 collection. But In cant see in the logs why its happening.

ANy advice appreciated. ;) again. lol
ukracer
 
Posts: 61
Joined: Tue Feb 15th, 2011 6:31pm

Re: mailtraq not collecting pop3 completely

Postby ukracer » Mon Sep 16th, 2013 7:12am

It seems like many thousands of messages are stuck on the server .

This is the part of the logs that it all seems to go wrong

00000008 0000005E 15/09/2013 04:21:52 LIST 4106 ---> +OK 4106 5001
00000008 0000005E 15/09/2013 04:21:52 TOP 4106 0 ---> +OK
00000008 0000005E 15/09/2013 04:21:53 LIST 4107 ---> +OK 4107 30149
00000008 0000005E 15/09/2013 04:21:53 TOP 4107 0 ---> +OK
00000008 0000005E 15/09/2013 04:21:54 LIST 4108 ---> +OK 4108 30162
00000008 0000005E 15/09/2013 04:21:54 TOP 4108 0 ---> +OK
00000008 0000005E 15/09/2013 04:21:55 LIST 4109 ---> +OK 4109 5023
00000008 0000005E 15/09/2013 04:21:55 TOP 4109 0 ---> +OK
00000008 0000005E 15/09/2013 04:21:56 LIST 4110 ---> +OK 4110 30115
00000008 0000005E 15/09/2013 04:21:56 TOP 4110 0 ---> +OK
00000008 0000005E 15/09/2013 04:21:57 LIST 4111 ---> +OK 4111 30088
00000008 0000005E 15/09/2013 04:21:57 TOP 4111 0 ---> +OK
00000008 0000005E 15/09/2013 04:21:59 LIST 4112 ---> +OK 4112 30146
00000008 0000005E 15/09/2013 04:22:00 TOP 4112 0 ---> +OK
00000008 0000005E 15/09/2013 04:22:01 LIST 4113 ---> +OK 4113 44843
00000008 0000005E 15/09/2013 04:22:02 TOP 4113 0 ---> +OK
00000008 0000005E 15/09/2013 04:22:02 LIST 4114 ---> +OK 4114 5031
00000008 0000005E 15/09/2013 04:22:03 TOP 4114 0 ---> +OK
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->
00000008 0000005E 15/09/2013 04:22:03 LIST 4115 --->


But the number 4115 is not consistent as it alters each time it fails to collect.

00000008 00000001 15/09/2013 15:05:57 TOP 3543 0 ---> +OK
00000008 00000001 15/09/2013 15:05:58 LIST 3544 ---> +OK 3544 6480
00000008 00000001 15/09/2013 15:05:58 TOP 3544 0 ---> +OK
00000008 00000001 15/09/2013 15:06:00 LIST 3545 ---> +OK 3545 6201
00000008 00000001 15/09/2013 15:06:01 TOP 3545 0 ---> +OK
00000008 00000001 15/09/2013 15:06:01 LIST 3546 ---> +OK 3546 6254
00000008 00000001 15/09/2013 15:06:02 TOP 3546 0 ---> +OK
00000008 00000001 15/09/2013 15:06:02 LIST 3547 --->
00000008 00000001 15/09/2013 15:06:02 LIST 3547 --->
00000008 00000001 15/09/2013 15:06:02 LIST 3547 --->
00000008 00000001 15/09/2013 15:06:02 LIST 3547 --->
00000008 00000001 15/09/2013 15:06:02 LIST 3547 --->
00000008 00000001 15/09/2013 15:06:02 LIST 3547 --->
00000008 00000001 15/09/2013 15:06:02 LIST 3547 --->
00000008 00000001 15/09/2013 15:06:02 LIST 3547 --->
00000008 00000001 15/09/2013 15:06:02 LIST 3547 --->
00000008 00000001 15/09/2013 15:06:02 LIST 3547 --->
00000008 00000001 15/09/2013 15:06:02 LIST 3547 --->
00000008 00000001 15/09/2013 15:06:02 LIST 3547 --->
00000008 00000001 15/09/2013 15:06:02 LIST 3547 --->
00000008 00000001 15/09/2013 15:06:02 LIST 3547 --->
00000008 00000001 15/09/2013 15:06:02 LIST 3547 --->
00000008 00000001 15/09/2013 15:06:02 LIST 3547 --->
ukracer
 
Posts: 61
Joined: Tue Feb 15th, 2011 6:31pm

Re: mailtraq not collecting pop3 completely

Postby Elric Pedder » Mon Sep 16th, 2013 9:21am

What you are seeing is typical of a dropped connection. This can be quite hard to diagnose but it is still possible that the problem lies with a single message. The numbering system can change on each connection. You could use [url=http://resources.mailtraq.com/files/socketspy.zip]socketspy[/zip] to proxy the connection so you can get a full trace of what happened as the peer server might be issuing some sort of error. Do you have any anti-virus software in place that might have an effect? Can you collect POP3 from other servers?
Mailtraq Development and Escalation Support
Novitraq Incorporated
User avatar
Elric Pedder
Mailtraq Escalation Support
 
Posts: 2675
Joined: Tue Nov 23rd, 2004 1:16pm
Location: Montreal, Canada

Re: mailtraq not collecting pop3 completely

Postby ukracer » Mon Sep 16th, 2013 11:19am

Elric Pedder wrote:What you are seeing is typical of a dropped connection. This can be quite hard to diagnose but it is still possible that the problem lies with a single message. The numbering system can change on each connection. You could use [url=http://resources.mailtraq.com/files/socketspy.zip]socketspy[/zip] to proxy the connection so you can get a full trace of what happened as the peer server might be issuing some sort of error. Do you have any anti-virus software in place that might have an effect? Can you collect POP3 from other servers?


Cheers Elric.

One problem I now have is I have socketspy installed but not sure what I need to put in it or what to do with it lol

I dont have antivirus software that is running so that should be ok.

I can collect mail from paypal@westmidland-internet.co.uk ok but andy@westmidland-internet.co.uk is the one I have problem with.

I used to use pop3mailscan to delete problem messages but I rarely have 11220 messages sitting there ;) and I only have 64 bit machines now so it no longer works on these.
ukracer
 
Posts: 61
Joined: Tue Feb 15th, 2011 6:31pm

Re: mailtraq not collecting pop3 completely

Postby Elric Pedder » Mon Sep 16th, 2013 11:29am

You set the local port to something like 5110 and the remote to the same server and port you use in Mailtraq. Then you configure Mailtraq to collect from 127.0.0.1:5110 instead. Now Socketspy will capture the entire transmission.
Mailtraq Development and Escalation Support
Novitraq Incorporated
User avatar
Elric Pedder
Mailtraq Escalation Support
 
Posts: 2675
Joined: Tue Nov 23rd, 2004 1:16pm
Location: Montreal, Canada

Re: mailtraq not collecting pop3 completely

Postby ukracer » Mon Sep 16th, 2013 12:21pm

Elric Pedder wrote:You set the local port to something like 5110 and the remote to the same server and port you use in Mailtraq. Then you configure Mailtraq to collect from 127.0.0.1:5110 instead. Now Socketspy will capture the entire transmission.



wow I was just going to post and say I am not sure about the part in mailtraq and I tried a few things and boom....its working.

Watch this space as they say ;) You are a star!
ukracer
 
Posts: 61
Joined: Tue Feb 15th, 2011 6:31pm

Re: mailtraq not collecting pop3 completely

Postby ukracer » Mon Sep 16th, 2013 1:36pm

Ok it just threw a wobbly and stopped. this is the last message it recorded.

16/09/2013 18:41:59 From Local
LIST 3553

16/09/2013 18:41:59 From Remote
+OK 3553 2633

16/09/2013 18:41:59 From Local
TOP 3553 0

16/09/2013 18:42:00 From Remote
+OK
Return-path: <>
Envelope-to: andy@westmidland-internet.co.uk
Delivery-date: Sat, 20 Jul 2013 18:27:23 -0500
Received: from mailnull by isetta.websitewelcome.com with local (Exim 4.80)
.id 1V0gYd-000806-3S
.for andy@westmidland-internet.co.uk; Sat, 20 Jul 2013 18:27:23 -0500
X-Failed-Recipients: enko@bewell.net
Auto-Submitted: auto-replied
From: Mail Delivery System <Mailer-Daemon@isetta.websitewelcome.com>
To: andy@westmidland-internet.co.uk
Subject: Mail delivery failed: returning message to sender
Message-Id: <E1V0gYd-000806-3S@isetta.websitewelcome.com>
Date: Sat, 20 Jul 2013 18:27:23 -0500

.

16/09/2013 18:42:00 From Local
LIST 3554

16/09/2013 18:42:00 From Remote
+OK 3554 5425

16/09/2013 18:42:00 From Local
TOP 3554 0

16/09/2013 18:42:00 Connection Closed
ukracer
 
Posts: 61
Joined: Tue Feb 15th, 2011 6:31pm

Re: mailtraq not collecting pop3 completely

Postby ukracer » Mon Sep 16th, 2013 1:55pm

Ok it just threw a wobbly and stopped. this is the last message it recorded.

16/09/2013 18:41:59 From Local
LIST 3553

16/09/2013 18:41:59 From Remote
+OK 3553 2633

16/09/2013 18:41:59 From Local
TOP 3553 0

16/09/2013 18:42:00 From Remote
+OK
Return-path: <>
Envelope-to: andy@westmidland-internet.co.uk
Delivery-date: Sat, 20 Jul 2013 18:27:23 -0500
Received: from mailnull by isetta.websitewelcome.com with local (Exim 4.80)
.id 1V0gYd-000806-3S
.for andy@westmidland-internet.co.uk; Sat, 20 Jul 2013 18:27:23 -0500
X-Failed-Recipients: enko@bewell.net
Auto-Submitted: auto-replied
From: Mail Delivery System <Mailer-Daemon@isetta.websitewelcome.com>
To: andy@westmidland-internet.co.uk
Subject: Mail delivery failed: returning message to sender
Message-Id: <E1V0gYd-000806-3S@isetta.websitewelcome.com>
Date: Sat, 20 Jul 2013 18:27:23 -0500

.

16/09/2013 18:42:00 From Local
LIST 3554

16/09/2013 18:42:00 From Remote
+OK 3554 5425

16/09/2013 18:42:00 From Local
TOP 3554 0

16/09/2013 18:42:00 Connection Closed
ukracer
 
Posts: 61
Joined: Tue Feb 15th, 2011 6:31pm

Re: mailtraq not collecting pop3 completely

Postby ukracer » Mon Sep 16th, 2013 5:16pm

Just running it all again and I will see if its the same message that gives problems. Then all I need is a program that I can access the server and delete the offending message somehow. lol
ukracer
 
Posts: 61
Joined: Tue Feb 15th, 2011 6:31pm

Re: mailtraq not collecting pop3 completely

Postby ukracer » Mon Sep 16th, 2013 6:02pm

next error position.

16/09/2013 23:19:58 From Local
LIST 3802

16/09/2013 23:19:58 From Remote
+OK 3802 5687

16/09/2013 23:19:58 From Local
TOP 3802 0

16/09/2013 23:19:59 From Remote
+OK
Return-path: <>
Envelope-to: andy@westmidland-internet.co.uk
Delivery-date: Sun, 21 Jul 2013 14:30:38 -0500
Received: from mailnull by isetta.websitewelcome.com with local (Exim 4.80)
.id 1V0zL4-0006Zh-1m
.for andy@westmidland-internet.co.uk; Sun, 21 Jul 2013 14:30:38 -0500
X-Failed-Recipients: jacksonvalerie2@aol.com,
dvmdoggie@aol.com,
patriciatpt@aol.com,
socalmikel@aol.com,
fragnello@aol.com,
dubojim71@aol.com,
geno11153@aol.com,
duel58@aol.com,
flhsr1212@aol.com,
bicknese@aol.com,
h2marcia@aol.com,
nursejennie76@aol.com,
eselim9175@aol.com,
tobaccoguy69@aol.com,
pitacat1@aol.com,
savtoy@aol.com,
ninorc131@aol.com,
alepori@aol.com,
tarkalsonp@aol.com,
rmaxshea@aol.com
Auto-Submitted: auto-replied
From: Mail Delivery System <Mailer-Daemon@isetta.websitewelcome.com>
To: andy@westmidland-internet.co.uk
Subject: Mail delivery failed: returning message to sender
Message-Id: <E1V0zL4-0006Zh-1m@isetta.websitewelcome.com>
Date: Sun, 21 Jul 2013 14:30:38 -0500

.

16/09/2013 23:19:59 From Local
LIST 3803

16/09/2013 23:19:59 From Remote
+OK 3803 14188

16/09/2013 23:19:59 From Local
TOP 3803 0

16/09/2013 23:20:00 From Remote
+OK
Return-path: <langehgiunv@apcl.pt>
Envelope-to: langehgi@westmidland-internet.co.uk
Delivery-date: Sun, 21 Jul 2013 14:31:12 -0500
Received: from [186.43.110.146] (port=10836)
.by isetta.websitewelcome.com with esmtp (Exim 4.80)
.(envelope-from <langehgiunv@apcl.pt>)
.id 1V0zLb-0007db-Vx
.for langehgi@westmidland-internet.co.uk; Sun, 21 Jul 2013 14:31:12 -0500
X-VirtualServer: Default, smailer1.service.apcl.pt, 10.10.93.3
X-VirtualServerGroup: Default
X-MailingID: 62232184::20130721.68566349::1001::MDB-PRD-BUL-20130721.41258501::langehgi@westmidland-internet.co.uk::27188
X-SMHeaderMap: mid="X-MailingID"
X-Destination-ID: langehgi@westmidland-internet.co.uk
X-SMFBL: tCglLAUIOWyPLSiumeIpAqqPcginRMFKmao=
Content-Type: text/html; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
x-subscriber: fsLbkYAUzVJSoOKLJJYNuYXZkhWlUOyWugY=
X-AccountCode: USEERE
Errors-To: errors@apcl.pt
Reply-To: noreply@apcl.pt
List-Unsubscribe: <mailto:71556826-20130721@unsubs.apcl.pt>, <http://www.apcl.pt/unsubscribe.php/msg/07100857/20130721>
MIME-Version: 1.0
Message-ID: <0a0b6fa2c4d7a.20130721.7eece59c30.ab2b52beccb7@EXPEUEW7>
Subject: Get Slim Easy! Start today!
Date: Sun, 21 Jul 2013 14:31:17 -0500
To: langehgi@westmidland-internet.co.uk
From: "Oprah-Show Newsletter" <langehgiunv@apcl.pt>

.

16/09/2013 23:20:00 Connection Closed
ukracer
 
Posts: 61
Joined: Tue Feb 15th, 2011 6:31pm

Re: mailtraq not collecting pop3 completely

Postby ukracer » Mon Sep 16th, 2013 7:11pm

next disconnection.


17/09/2013 00:25:59 From Local
TOP 2767 0

17/09/2013 00:25:59 From Remote
+OK
Return-path: <>
Envelope-to: andy@westmidland-internet.co.uk
Delivery-date: Fri, 19 Jul 2013 12:24:20 -0500
Received: from gateway12.websitewelcome.com ([69.56.148.16]:59087)
.by isetta.websitewelcome.com with esmtp (Exim 4.80)
.id 1V0EPk-0007C1-Im
.for andy@westmidland-internet.co.uk; Fri, 19 Jul 2013 12:24:20 -0500
Received: by gateway12.websitewelcome.com (Postfix)
.id 701299DA57ECF; Fri, 19 Jul 2013 12:24:18 -0500 (CDT)
Date: Fri, 19 Jul 2013 12:24:18 -0500 (CDT)
From: MAILER-DAEMON@gateway12.websitewelcome.com (Mail Delivery System)
Subject: Undelivered Mail Returned to Sender
To: andy@westmidland-internet.co.uk
Auto-Submitted: auto-replied
MIME-Version: 1.0
Content-Type: multipart/report; report-type=delivery-status;
.boundary="95E769D9A3E17.1374254658/gateway12.websitewelcome.com"
Message-Id: <20130719172418.701299DA57ECF@gateway12.websitewelcome.com>

.

17/09/2013 00:25:59 From Local
LIST 2768

17/09/2013 00:26:00 From Remote
+OK 2768 7929

17/09/2013 00:26:00 From Local
TOP 2768 0

17/09/2013 00:26:00 Connection Closed
ukracer
 
Posts: 61
Joined: Tue Feb 15th, 2011 6:31pm

Re: mailtraq not collecting pop3 completely

Postby ukracer » Tue Sep 17th, 2013 6:09am

Another disconnection.
+OK 3662 5193

17/09/2013 07:05:58 From Local
TOP 3662 0

17/09/2013 07:05:59 From Remote
+OK
Return-path: <>
Envelope-to: andy@westmidland-internet.co.uk
Delivery-date: Sun, 21 Jul 2013 10:04:12 -0500
Received: from gateway01.websitewelcome.com ([67.18.53.19]:48276)
.by isetta.websitewelcome.com with esmtp (Exim 4.80)
.id 1V0vBE-0007QW-9a
.for andy@westmidland-internet.co.uk; Sun, 21 Jul 2013 10:04:12 -0500
Received: by gateway01.websitewelcome.com (Postfix)
.id 4152B81BF8125; Sun, 21 Jul 2013 10:04:12 -0500 (CDT)
Date: Sun, 21 Jul 2013 10:04:12 -0500 (CDT)
From: MAILER-DAEMON@gateway01.websitewelcome.com (Mail Delivery System)
Subject: Undelivered Mail Returned to Sender
To: andy@westmidland-internet.co.uk
Auto-Submitted: auto-replied
MIME-Version: 1.0
Content-Type: multipart/report; report-type=delivery-status;
.boundary="449B181BF75B7.1374419052/gateway01.websitewelcome.com"
Message-Id: <20130721150412.4152B81BF8125@gateway01.websitewelcome.com>

.

17/09/2013 07:05:59 From Local
LIST 3663

17/09/2013 07:05:59 From Remote
+OK 3663 70482

17/09/2013 07:05:59 From Local
TOP 3663 0

17/09/2013 07:06:00 Connection Closed
ukracer
 
Posts: 61
Joined: Tue Feb 15th, 2011 6:31pm

Re: mailtraq not collecting pop3 completely

Postby ukracer » Tue Sep 17th, 2013 9:32am

There seems to be no consistency with where its disconnecting so is it possible to force mailtraq to download mail from a pop3 account in portions of say 100 to 500 emails at a time.

The problem is only going to get worse day by day with more mail piling up on the server. (from what I can make out) ;(

Regards Andy T
ukracer
 
Posts: 61
Joined: Tue Feb 15th, 2011 6:31pm

Re: mailtraq not collecting pop3 completely

Postby Elric Pedder » Tue Sep 17th, 2013 2:12pm

It seems that the TOP command is retrieving something that a transparent proxy doesn't like. It might be killing the connection when it detects some indication of a virus or spam before Mailtraq can see it. If you can send me the credentials via PM I could run some tests.
Mailtraq Development and Escalation Support
Novitraq Incorporated
User avatar
Elric Pedder
Mailtraq Escalation Support
 
Posts: 2675
Joined: Tue Nov 23rd, 2004 1:16pm
Location: Montreal, Canada

Re: mailtraq not collecting pop3 completely

Postby ukracer » Tue Sep 17th, 2013 3:32pm

Elric Pedder wrote:It seems that the TOP command is retrieving something that a transparent proxy doesn't like. It might be killing the connection when it detects some indication of a virus or spam before Mailtraq can see it. If you can send me the credentials via PM I could run some tests.


All sent mate life saver... ;)
ukracer
 
Posts: 61
Joined: Tue Feb 15th, 2011 6:31pm

Next

Return to Mailtraq Support

Who is online

Users browsing this forum: Google [Bot] and 4 guests

cron