NuSphere Forums Forum Index
NuSphere Forums
Reply to topic
Site Admin

Joined: 13 Jul 2003
Posts: 8334
Reply with quote
@simshaun

No. All was by default. FileZilla with 2 connections and PhpED with one.
Please note that increasing number of connections for FileZilla won't get any performance improvements. It can not be scaled after CPU utilization reached 100% and it did stay at 100% for most of the time when FileZilla transferred the files.
I'd say that FileZilla does its best to make it looking like the transfer goes extremely fast. But it's only pretending.
If you think it makes sense to check FileZilla with 1 connection, I'll check.

Quote:
Some FTP servers only allow single connections by the way


I'm not sure that any server will do so without some special settings. At least I didn't see anything like that with the defaults.

Quote:
I thought the whole point of this side-tracked thread was the comparison of multiple-connections vs single connections, not the performance of the FTP client itself.


may be. But wording I read from the other opponent suggested that he means the FTP client of PhpED.


Quote:
I use FileZilla with up to 5 concurrent connections to my dedicated's, and it always uploads/downloads faster so long as I'm dealing with lots of small files because


Sorry, but it looks like you didn't read my comments or they wasn't clear to you.
If your ISP or server's ISP or any router in between limits the network (IP) throughoutput per connection, you can improve the situation by increasing number of connections. In the other cases, you can't. If you don't agree, please explain how it would be possible Smile. If you compare performance of HDD, RAM, PCI-E, Ethernet with Internet perfomance, you'll see it clear that the Network is always the bottleneck. Perhaps, it's also possible that server is overloaded and can't accept files even with that performance, but it's an edge case and I'd not consider it at all.

On the other hand, if the Network performance is high enough, you can easily get your server on the knees with multiple connections. Check server load with sufficiently big number of files and sufficiently big number of connections.

Quote:
Also, I have no problems running FileZilla at all with other intensive applications running (Photoshop, Illustrator, Flash, Dreamweaver, PHPEd), and my computer is not that snazzy.


It's clear because you're transferring through the Network, where the bottleneck is outside of your computer. It means that most of the time FTP client waits for the server to respond. That's why utilization is not that high.
With local transfers you'd get pure perfomance of FTP client itself.
Otherwise you're only fooling the routers and get more bandwidth.

_________________
The PHP IDE team
View user's profileFind all posts by dmitriSend private messageVisit poster's website


Joined: 14 Apr 2006
Posts: 33
Reply with quote
dmitri wrote:
FTP: vsftpd 2.0.5
Server OS: CentOS 5.1 (vmware 6)
HW: Core2Duo/3GHz/2GB RAM

Filezilla 3.2.3
PhpED 5.6.5637

Files: Joomla Package
total size: 13'418'716
the smallest: 15
the biggest: 294'042
number of files: 3933

timings (ran 3 times): PhpED 26-29s, FileZilla 34-35s,
PhpED is >17% faster.

I'd note that with PhpED CPU usage was about 30% and less which would allow me to work.
With FileZilla CPU utilization was quckly jumping from 60% to 100% and back. It would hardly let me to work (if I wanted).


(Sorry to the OP for taking this slightly off topic)

Dmitri, was this FTP to a server on the internet or a server local on your network?

And is that uploading by selecting the files in the editor and pressing CTRL+SHIFT+S / F to upload them?

_________________
Regards

Steve.
View user's profileFind all posts by MGSteveSend private message
Site Admin

Joined: 13 Jul 2003
Posts: 8334
Reply with quote
Quote:
Dmitri, was this FTP to a server on the internet or a server local on your network?


Neither. As I told in the beginning the main purpose of the test was to eliminate the network as much as possible or you will test who's better "fooling" the network. That's why I ran the test under CentOS 5.1/vmware 6, read: local machine.

Quote:
And is that uploading by selecting the files in the editor and pressing CTRL+SHIFT+S / F to upload them?


By right clicking on the project -> upload (Shift+Ctrl+P)

_________________
The PHP IDE team
View user's profileFind all posts by dmitriSend private messageVisit poster's website


Joined: 14 Apr 2006
Posts: 33
Reply with quote
dmitri wrote:
Quote:
Dmitri, was this FTP to a server on the internet or a server local on your network?


Neither. As I told in the beginning the main purpose of the test was to eliminate the network as much as possible or you will test who's better "fooling" the network. That's why I ran the test under CentOS 5.1/vmware 6, read: local machine.

Ah right, well that's a real world scenario then.

Well, locally phpEd may be quicker, in the real world scenario of uploading a load of files onto a remote server, phpEd is mega slow.

_________________
Regards

Steve.
View user's profileFind all posts by MGSteveSend private message
Site Admin

Joined: 13 Jul 2003
Posts: 8334
Reply with quote
Steve,

If PhpED is megaslow, FileZilla is nevertheless megaslower Smile
What actually slow is your network, not PhpED.
Still it makes sense to use FileZilla for you and some other customers who can't afford good network connections. In this case it's possible to get quite noticable benefits from using free FileZilla.

Quote:
Ah right, well that's a real world scenario then


Sure. Otherwise I would not post it.

_________________
The PHP IDE team
View user's profileFind all posts by dmitriSend private messageVisit poster's website
Veteran

Joined: 22 May 2008
Posts: 141
Reply with quote
dmitri wrote:
Steve,

If PhpED is megaslow, FileZilla is nevertheless megaslower Smile
What actually slow is your network, not PhpED.
Still it makes sense to use FileZilla for you and some other customers who can't afford good network connections. In this case it's possible to get quite noticable benefits from using free FileZilla.


I'm runnin 5meg DSL. Not the fastest by any means, but not slow.
Anyways, here is my stats:

===========================
Package: Joomla 1.5.9 Full Package
Destination: Dedicated server half-way across the country
Network: No other bandwidth is being used on either test:
Timed: with Stopwatch
PC: 2.61Ghz Dual-Core AMD Opteron, 2.5gb RAM, Windows XP


PHPEd, single connection: 1 hr 4 min 2 seconds
FileZilla, 5 simultaneous connections: 0 hr 22 min 03 seconds (also never above 2% CPU utilization).
===========================
View user's profileFind all posts by simshaunSend private message


Joined: 18 Sep 2007
Posts: 54
Location: Croatia
Reply with quote
I won't go into discussion who has bigger... er faster connection, but to replay to first post:

Let say that you have some sort of renaming routine.
This won't do much if you build your site on some sort of framework, 'cos if old index is dependent on new include that is not compatible with old version, than you have a major flaw in your site logic.

Especially if you changed your DB in the process.

So secondary web application server is a must, or you will have to drop down connection until everything is in order and sync with development.
View user's profileFind all posts by konixnetSend private messageVisit poster's website
Site Admin

Joined: 13 Jul 2003
Posts: 8334
Reply with quote
Quote:
@simshaun

Quote:
I'm runnin 5meg DSL. Not the fastest by any means, but not slow.
Anyways, here is my stats:

===========================
Package: Joomla 1.5.9 Full Package
Destination: Dedicated server half-way across the country
Network: No other bandwidth is being used on either test:
Timed: with Stopwatch
PC: 2.61Ghz Dual-Core AMD Opteron, 2.5gb RAM, Windows XP


would you please let us know the file sizes, like I did (the smallest, the biggest, total size, total number of files)?

_________________
The PHP IDE team
View user's profileFind all posts by dmitriSend private messageVisit poster's website
Veteran

Joined: 22 May 2008
Posts: 141
Reply with quote
dmitri wrote:
Quote:
@simshaun


would you please let us know the file sizes, like I did (the smallest, the biggest, total size, total number of files)?


There are:
724 folders
3916 files
Total size: 12.8MB
Largest file: unicode_data.php - 287KB
Smallest files: 0KB
3647 files 10KB and under
240 files 10KB - 50KB
11 files 50KB - 100KB
14 files 100KB - 287KB
View user's profileFind all posts by simshaunSend private message
Site Admin

Joined: 13 Jul 2003
Posts: 8334
Reply with quote
So the average kb/s in Filezilla was:
12.8 * 1024 / 5 / (22 * 60 + 3) = 1.98kB/sec, or 1.98*5=9.9kB/sec for all 5 connections.

in PhpED it was:
12.8 * 1024 / (1*3600+4*60+2) = 3.41kB/sec

now, please tell me that the throughoutput like 2-3 kB per second is caused by poor FTP clients like the ones in FileZilla or PhpED Smile

FTP server and network have some delay when executing/passing each command. The more commands you run the more delay in total. If you transfer 1 file of 12.8MB it will complete many times faster.

In other words, it has nothing to do with FTP clients like FileZilla or PhpED.
Both can provide files at speed of some dozen megabytes per second.
It's network and server can not accept such streams, at least through one FTP connection.

_________________
The PHP IDE team
View user's profileFind all posts by dmitriSend private messageVisit poster's website
Veteran

Joined: 22 May 2008
Posts: 141
Reply with quote
Regardless of how fast the connection is going in PhpED and FileZilla, the fact of the matter is the transfer I made in FileZilla was faster because of running 5x connections.

If I was only uploading single 12.8MB files, then sure I wouldn't care. After all, only 1 connection is going to be made for it either way.
View user's profileFind all posts by simshaunSend private message
Site Admin

Joined: 13 Jul 2003
Posts: 8334
Reply with quote
correct, but it does not mean that the problem is in PhpED Smile

Quote:
Regardless of how fast the connection is going


I believe it's very important, though. With faster server & network, you could get better results even with one connection. Just my 2 cents.

_________________
The PHP IDE team
View user's profileFind all posts by dmitriSend private messageVisit poster's website
Upload as .php~ then Rename .php (high-volume sites)
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
All times are GMT - 5 Hours  
Page 2 of 3  

  
  
 Reply to topic