Eclipse Community Forums: DSDP - Target Management » RSE:What is the use of RemoteSystemsTempFiles in workspace?

Home » Eclipse Projects » DSDP - Target Management » RSE:What is the use of RemoteSystemsTempFiles in workspace?

RSE:What is the use of RemoteSystemsTempFiles in workspace? [message #36152]

Tue, 23 June 2009 20:58

Eclipse User

When we use RSE FTP to download a file from remote system to my pc,
the RSE FTP will copy this file from remote system to the floder named
RemoteSystemsTempFiles in workspace at first,and then copy this file from
RemoteSystemsTempFiles to target floder in my pc.
Why not to copy a file from remote system to target folder in my pc
directly?
what is the use of RemoteSystemsTempFiles in workspace?

Best Regards,
hemeihua

Re: RSE:What is the use of RemoteSystemsTempFiles in workspace? [message #36220 is a reply to message #36152]

Thu, 25 June 2009 15:33

Eclipse User

The approach RSE uses for downloading and uploading is a design decision.
When opening a file for editing, RSE downloads to the RemoteSystemsTempFiles
project so that the file can be edited as an IFile using standard Eclipse
editors. This project is a local cache of downloaded files with associated
information like timestamps to allow for in-place editing. This is true
even in the case of a Local file subsystem, where download() and upload()
methods are essentially copying files - the RSE framework treats the local
file subsystem the same as any other remote file subsystem. The mechanism
used for transfering files between different systems follows the pattern of
first downloading to the RemoteSystemsTempFiles project if necessary (like
in the editor scenario) and then uploading to the target Remote file
subsystem to maintain consistency. As a rule, things can get problemmatic
when one subsystem makes assumptions about other subsystems so no special
exceptions are made for things like transfering to local.

"hemeihua " <he.meihua@zte.com.cn> wrote in message
news:319ff213cb60df563b9520d5a26b61c2$1@www.eclipse.org...
> When we use RSE FTP to download a file from remote system to my pc,
> the RSE FTP will copy this file from remote system to the floder named
> RemoteSystemsTempFiles in workspace at first,and then copy this file from
> RemoteSystemsTempFiles to target floder in my pc. Why not to copy a file
> from remote system to target folder in my pc directly?
> what is the use of RemoteSystemsTempFiles in workspace?
>
> Best Regards,
> hemeihua
>
>

Re: RSE:What is the use of RemoteSystemsTempFiles in workspace? [message #36440 is a reply to message #36220]

Mon, 29 June 2009 07:26

Eclipse User

Hello David,
Since it is a design decision,there is a problem in uploading a large
folder.
First I set maximum cached size 2048MB,then I upload a large
folder(1.02GB),but an internal error occurred.
Here is log information:

!ENTRY org.eclipse.core.jobs 4 2 2009-06-29 17:17:19.031
!MESSAGE An internal error occurred during: "Updating workspace".
!STACK 0
java.lang.OutOfMemoryError: Java heap space
at
org.eclipse.core.internal.jobs.DeadlockDetector.resizeGraph( DeadlockDetector.java:630)
at
org.eclipse.core.internal.jobs.DeadlockDetector.lockAcquired (DeadlockDetector.java:290)
at
org.eclipse.core.internal.jobs.LockManager.addLockThread(Loc kManager.java:124)
at
org.eclipse.core.internal.jobs.OrderedLock.setCurrentOperati onThread(OrderedLock.java:268)
at
org.eclipse.core.internal.jobs.OrderedLock.attempt(OrderedLo ck.java:123)
at
org.eclipse.core.internal.jobs.OrderedLock.createSemaphore(O rderedLock.java:142)
at
org.eclipse.core.internal.jobs.OrderedLock.acquire(OrderedLo ck.java:100)
at org.eclipse.core.internal.jobs.OrderedLock.acquire(OrderedLo ck.java:82)
at
org.eclipse.core.internal.resources.WorkManager.checkIn(Work Manager.java:118)
at
org.eclipse.core.internal.resources.Workspace.prepareOperati on(Workspace.java:1744)
at org.eclipse.core.internal.resources.Workspace.run(Workspace. java:1792)
at
org.eclipse.core.internal.events.NotificationManager$NotifyJ ob.run(NotificationManager.java:39)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:55)
!SESSION 2009-06-29 18:13:01.266
-----------------------------------------------
eclipse.buildId=I20070625-1500
java.version=1.6.0_01
java.vendor=Sun Microsystems Inc.
BootLoader constants: OS=win32, ARCH=x86, WS=win32, NL=zh_CN
Framework arguments: -product org.eclipse.sdk.ide -pdelaunch
Command-line arguments: -product org.eclipse.sdk.ide -data
D:\FTP\ECLIPSE\rse_3.0.1\WS/../runtime-New_configuration -dev
file:D:/FTP/ECLIPSE/rse_3.0.1/WS/.metadata/.plugins/org.ecli pse.pde.core/New_configuration/dev.properties
-pdelaunch -os win32 -ws win32 -arch x86

Sometimes I do the same thing like above,another internal error occurred.
Here is log information:

!ENTRY org.eclipse.core.jobs 4 2 2009-06-29 18:16:32.749
!MESSAGE An internal error occurred during: "Transfer Operation".
!STACK 0
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Arrays.java:2882)
at java.lang.String.<init>(String.java:179)
at java.io.Win32FileSystem.resolve(Win32FileSystem.java:241)
at java.io.File.<init>(File.java:312)
at
org.eclipse.rse.internal.services.local.files.LocalFileServi ce$LocalFileNameFilter.accept(LocalFileService.java:200)
at java.io.File.listFiles(File.java:1094)
at
org.eclipse.rse.internal.services.local.files.LocalFileServi ce.internalFetch(LocalFileService.java:737)
at
org.eclipse.rse.services.files.AbstractFileService.list(Abst ractFileService.java:103)
at
org.eclipse.rse.subsystems.files.core.servicesubsystem.FileS erviceSubSystem.internalList(FileServiceSubSystem.java:375)
at
org.eclipse.rse.subsystems.files.core.servicesubsystem.FileS erviceSubSystem.list(FileServiceSubSystem.java:567)
at
org.eclipse.rse.subsystems.files.core.subsystems.RemoteFileS ubSystem.list(RemoteFileSubSystem.java:975)
at
org.eclipse.rse.subsystems.files.core.subsystems.RemoteFileS ubSystem.list(RemoteFileSubSystem.java:950)
at
org.eclipse.rse.files.ui.resources.UniversalFileTransferUtil ity.downloadResourcesToWorkspaceMultiple(UniversalFileTransf erUtility.java:484)
at
org.eclipse.rse.files.ui.resources.UniversalFileTransferUtil ity.downloadResourcesToWorkspaceMultiple(UniversalFileTransf erUtility.java:489)
at
org.eclipse.rse.files.ui.resources.UniversalFileTransferUtil ity.downloadResourcesToWorkspaceMultiple(UniversalFileTransf erUtility.java:489)
at
org.eclipse.rse.files.ui.resources.UniversalFileTransferUtil ity.downloadResourcesToWorkspaceMultiple(UniversalFileTransf erUtility.java:489)
at
org.eclipse.rse.files.ui.resources.UniversalFileTransferUtil ity.downloadResourcesToWorkspaceMultiple(UniversalFileTransf erUtility.java:489)
at
org.eclipse.rse.files.ui.resources.UniversalFileTransferUtil ity.downloadResourcesToWorkspaceMultiple(UniversalFileTransf erUtility.java:489)
at
org.eclipse.rse.files.ui.resources.UniversalFileTransferUtil ity.downloadResourcesToWorkspaceMultiple(UniversalFileTransf erUtility.java:489)
at
org.eclipse.rse.internal.files.ui.view.SystemViewRemoteFileA dapter.doDrag(SystemViewRemoteFileAdapter.java:1688)
at
org.eclipse.rse.internal.ui.view.SystemDNDTransferRunnable.t ransferRSEResources(SystemDNDTransferRunnable.java:192)
at
org.eclipse.rse.internal.ui.view.SystemDNDTransferRunnable.r unInWorkspace(SystemDNDTransferRunnable.java:606)
at
org.eclipse.core.internal.resources.InternalWorkspaceJob.run (InternalWorkspaceJob.java:38)
at org.eclipse.core.internal.jobs.Worker.run(Worker.java:55)

To suppose that I uploaded the large folder(1.02GB) successfully, RSE FTP
will use more time than other ftp such as cuteftp to upload a file.
So RSE FTP's efficiency of transmission is lower than other ftp.

How to deal with the internal error? How to enhance the transmission
efficiency of RSE FTP?

Thanks ahead of time.

hemeihua

Re: RSE:What is the use of RemoteSystemsTempFiles in workspace? [message #36659 is a reply to message #36440]

Tue, 30 June 2009 11:51

Eclipse User

I'm not sure what you mean by "set maximum cached size"? Are you referring
to the value for the Remote Systems->File Cache preferences or something
else? Are you able to do the operation if you divide it up into a group of
smaller uploads?

"hemeihua " <he.meihua@zte.com.cn> wrote in message
news:8ba35d35cfafbd37b195c69f799fb5a5$1@www.eclipse.org...
> Hello David,
> Since it is a design decision,there is a problem in uploading a large
> folder.
> First I set maximum cached size 2048MB,then I upload a large
> folder(1.02GB),but an internal error occurred.
> Here is log information:
>
> !ENTRY org.eclipse.core.jobs 4 2 2009-06-29 17:17:19.031
> !MESSAGE An internal error occurred during: "Updating workspace".
> !STACK 0
> java.lang.OutOfMemoryError: Java heap space
> at
> org.eclipse.core.internal.jobs.DeadlockDetector.resizeGraph( DeadlockDetector.java:630)
> at
> org.eclipse.core.internal.jobs.DeadlockDetector.lockAcquired (DeadlockDetector.java:290)
> at
> org.eclipse.core.internal.jobs.LockManager.addLockThread(Loc kManager.java:124)
> at
> org.eclipse.core.internal.jobs.OrderedLock.setCurrentOperati onThread(OrderedLock.java:268)
> at
> org.eclipse.core.internal.jobs.OrderedLock.attempt(OrderedLo ck.java:123)
> at
> org.eclipse.core.internal.jobs.OrderedLock.createSemaphore(O rderedLock.java:142)
> at
> org.eclipse.core.internal.jobs.OrderedLock.acquire(OrderedLo ck.java:100)
> at org.eclipse.core.internal.jobs.OrderedLock.acquire(OrderedLo ck.java:82)
> at
> org.eclipse.core.internal.resources.WorkManager.checkIn(Work Manager.java:118)
> at
> org.eclipse.core.internal.resources.Workspace.prepareOperati on(Workspace.java:1744)
> at org.eclipse.core.internal.resources.Workspace.run(Workspace. java:1792)
> at
> org.eclipse.core.internal.events.NotificationManager$NotifyJ ob.run(NotificationManager.java:39)
> at org.eclipse.core.internal.jobs.Worker.run(Worker.java:55)
> !SESSION 2009-06-29
> 18:13:01.266 -----------------------------------------------
> eclipse.buildId=I20070625-1500
> java.version=1.6.0_01
> java.vendor=Sun Microsystems Inc.
> BootLoader constants: OS=win32, ARCH=x86, WS=win32, NL=zh_CN
> Framework arguments: -product org.eclipse.sdk.ide -pdelaunch
> Command-line arguments: -product org.eclipse.sdk.ide -data
> D:\FTP\ECLIPSE\rse_3.0.1\WS/../runtime-New_configuration -dev
> file:D:/FTP/ECLIPSE/rse_3.0.1/WS/.metadata/.plugins/org.ecli pse.pde.core/New_configuration/dev.properties -
> pdelaunch -os win32 -ws win32 -arch x86
>
> Sometimes I do the same thing like above,another internal error occurred.
> Here is log information:
>
> !ENTRY org.eclipse.core.jobs 4 2 2009-06-29 18:16:32.749
> !MESSAGE An internal error occurred during: "Transfer Operation".
> !STACK 0
> java.lang.OutOfMemoryError: Java heap space
> at java.util.Arrays.copyOf(Arrays.java:2882)
> at java.lang.String.<init>(String.java:179)
> at java.io.Win32FileSystem.resolve(Win32FileSystem.java:241)
> at java.io.File.<init>(File.java:312)
> at
> org.eclipse.rse.internal.services.local.files.LocalFileServi ce$LocalFileNameFilter.accept(LocalFileService.java:200)
> at java.io.File.listFiles(File.java:1094)
> at
> org.eclipse.rse.internal.services.local.files.LocalFileServi ce.internalFetch(LocalFileService.java:737)
> at
> org.eclipse.rse.services.files.AbstractFileService.list(Abst ractFileService.java:103)
> at
> org.eclipse.rse.subsystems.files.core.servicesubsystem.FileS erviceSubSystem.internalList(FileServiceSubSystem.java:375)
> at
> org.eclipse.rse.subsystems.files.core.servicesubsystem.FileS erviceSubSystem.list(FileServiceSubSystem.java:567)
> at
> org.eclipse.rse.subsystems.files.core.subsystems.RemoteFileS ubSystem.list(RemoteFileSubSystem.java:975)
> at
> org.eclipse.rse.subsystems.files.core.subsystems.RemoteFileS ubSystem.list(RemoteFileSubSystem.java:950)
> at
> org.eclipse.rse.files.ui.resources.UniversalFileTransferUtil ity.downloadResourcesToWorkspaceMultiple(UniversalFileTransf erUtility.java:484)
> at
> org.eclipse.rse.files.ui.resources.UniversalFileTransferUtil ity.downloadResourcesToWorkspaceMultiple(UniversalFileTransf erUtility.java:489)
> at
> org.eclipse.rse.files.ui.resources.UniversalFileTransferUtil ity.downloadResourcesToWorkspaceMultiple(UniversalFileTransf erUtility.java:489)
> at
> org.eclipse.rse.files.ui.resources.UniversalFileTransferUtil ity.downloadResourcesToWorkspaceMultiple(UniversalFileTransf erUtility.java:489)
> at
> org.eclipse.rse.files.ui.resources.UniversalFileTransferUtil ity.downloadResourcesToWorkspaceMultiple(UniversalFileTransf erUtility.java:489)
> at
> org.eclipse.rse.files.ui.resources.UniversalFileTransferUtil ity.downloadResourcesToWorkspaceMultiple(UniversalFileTransf erUtility.java:489)
> at
> org.eclipse.rse.files.ui.resources.UniversalFileTransferUtil ity.downloadResourcesToWorkspaceMultiple(UniversalFileTransf erUtility.java:489)
> at
> org.eclipse.rse.internal.files.ui.view.SystemViewRemoteFileA dapter.doDrag(SystemViewRemoteFileAdapter.java:1688)
> at
> org.eclipse.rse.internal.ui.view.SystemDNDTransferRunnable.t ransferRSEResources(SystemDNDTransferRunnable.java:192)
> at
> org.eclipse.rse.internal.ui.view.SystemDNDTransferRunnable.r unInWorkspace(SystemDNDTransferRunnable.java:606)
> at
> org.eclipse.core.internal.resources.InternalWorkspaceJob.run (InternalWorkspaceJob.java:38)
> at org.eclipse.core.internal.jobs.Worker.run(Worker.java:55)
>
> To suppose that I uploaded the large folder(1.02GB) successfully, RSE FTP
> will use more time than other ftp such as cuteftp to upload a file.
> So RSE FTP's efficiency of transmission is lower than other ftp.
>
> How to deal with the internal error? How to enhance the transmission
> efficiency of RSE FTP?
>
> Thanks ahead of time.
>
> hemeihua
>

Re: RSE:What is the use of RemoteSystemsTempFiles in workspace? [message #36760 is a reply to message #36659]

Thu, 02 July 2009 00:32

Eclipse User

Hello David,
yes,"set maximum cached size" is referring to the value for the Remote
Systems->File Cache preferences. I can upload a smaller file which size is
about 100MB-600MB ,but can not upload a larger file(above 1GB) which can
not been divided and an internal error occurred. How to deal with the
internal error? To suppose that I uploaded a large file(1.02GB)
successfully, RSE FTP will use more time than other ftp such as cuteftp to
upload a file.
So RSE FTP's efficiency of transmission is lower than other ftp.
How to enhance the transmission efficiency of RSE FTP?

Have you any way to avoid copying file to RemoteSystemsTempFiles and
directly copy a file from source to target folder?
or
is there a switch when opening a file for editing, RSE downloads to the
RemoteSystemsTempFiles and when uploading or downloading a file, RSE copy
a file from source to target folder directly, not pass through
RemoteSystemsTempFiles?

Best Regards,
hemeihua

Re: RSE:What is the use of RemoteSystemsTempFiles in workspace? [message #36829 is a reply to message #36760]

Thu, 02 July 2009 10:56

Eclipse User

Hi hemeihua,

In this particular scenario, I don't think setting the "maximum cached size"
will make any difference. The issue seems to be that when reading a very
large file, too much heap memory is being consumed.

One workaround for this may be the following:

In the eclipse.ini file, memory args for the JVM can be set. For example:

-Xms40m
-Xmx256m

You may be able to raise the max memory for Eclipse such that it will be
able to handle larger heap memory consumption.

Let me know whether this helps.
Dave

"hemeihua " <he.meihua@zte.com.cn> wrote in message
news:34b7be3ca14cf73334dc1ad8e7329a82$1@www.eclipse.org...
> Hello David,
> yes,"set maximum cached size" is referring to the value for the Remote
> Systems->File Cache preferences. I can upload a smaller file which size is
> about 100MB-600MB ,but can not upload a larger file(above 1GB) which can
> not been divided and an internal error occurred. How to deal with the
> internal error? To suppose that I uploaded a large file(1.02GB)
> successfully, RSE FTP will use more time than other ftp such as cuteftp to
> upload a file.
> So RSE FTP's efficiency of transmission is lower than other ftp.
> How to enhance the transmission efficiency of RSE FTP?
>
> Have you any way to avoid copying file to RemoteSystemsTempFiles and
> directly copy a file from source to target folder?
> or
> is there a switch when opening a file for editing, RSE downloads to the
> RemoteSystemsTempFiles and when uploading or downloading a file, RSE copy
> a file from source to target folder directly, not pass through
> RemoteSystemsTempFiles?
>
> Best Regards,
> hemeihua
>
>

Re: RSE:What is the use of RemoteSystemsTempFiles in workspace? [message #36996 is a reply to message #36829]

Fri, 03 July 2009 04:47

Eclipse User

Hi David,
The problem of OutOfMemoryError has solved,thanks!
But I have the other question:
RSE FTP will use more time than other FTP such as cuteftp to
upload a file.
So RSE FTP's efficiency of transmission is lower than other ftp.
How to enhance the transmission efficiency of RSE FTP?

Have you any way to avoid copying file to RemoteSystemsTempFiles and
directly copy a file from source to target folder?
or
is there a switch when opening a file for editing, RSE downloads to the
RemoteSystemsTempFiles and when uploading or downloading a file, RSE copy
a file from source to target folder directly, not pass through
RemoteSystemsTempFiles?

Best Regards,
hemeihua

Re: RSE:What is the use of RemoteSystemsTempFiles in workspace? [message #37269 is a reply to message #36996]

Wed, 08 July 2009 13:46

Eclipse User

Hi Hemeihua,

I think your request may be the same as that described here:
https://bugs.eclipse.org/bugs/show_bug.cgi?id=216763

If so, you may want to add your comments there. If not, you may want to
open a separate enhancement request.

There are also a couple other ftp performance bugs here:

https://bugs.eclipse.org/bugs/show_bug.cgi?id=180965
https://bugs.eclipse.org/bugs/show_bug.cgi?id=198636

Dave

"hemeihua " <he.meihua@zte.com.cn> wrote in message
news:2ecedd3eef5ee98f03a06d4a52bfc2c6$1@www.eclipse.org...
> Hi David,
> The problem of OutOfMemoryError has solved,thanks!
> But I have the other question:
> RSE FTP will use more time than other FTP such as cuteftp to upload a
> file.
> So RSE FTP's efficiency of transmission is lower than other ftp.
> How to enhance the transmission efficiency of RSE FTP?
>
> Have you any way to avoid copying file to RemoteSystemsTempFiles and
> directly copy a file from source to target folder?
> or
> is there a switch when opening a file for editing, RSE downloads to the
> RemoteSystemsTempFiles and when uploading or downloading a file, RSE copy
> a file from source to target folder directly, not pass through
> RemoteSystemsTempFiles?
>
> Best Regards,
> hemeihua
>
>

Re: RSE:What is the use of RemoteSystemsTempFiles in workspace? [message #581282 is a reply to message #36152]

Thu, 25 June 2009 15:33

Eclipse User