Skip to main content


Eclipse Community Forums
Forum Search:

Search      Help    Register    Login    Home
Home » Modeling » EMF "Technology" (Ecore Tools, EMFatic, etc)  » [CDO][0.8.0] Streaming
[CDO][0.8.0] Streaming [message #96300] Fri, 07 September 2007 14:45 Go to next message
Simon Mc Duff is currently offline Simon Mc DuffFriend
Messages: 596
Registered: July 2009
Senior Member
Do you think we could stream the data. ?

Use case:
One of my attribute is Binary. I don't want to serialize it it all... it
will take too much time. I want to read it as it stream.(The file could be 1
gigs... 200 megs.. what whatever)

I want to stream it so the consumer can read it as its stream....

We could possibly send a CDOBinary.. and once the user read it.. open a
stream between the server and the client.

I don't think it should be very complicated.. isn't ?
Re: [CDO][0.8.0] Streaming [message #96318 is a reply to message #96300] Fri, 07 September 2007 15:11 Go to previous messageGo to next message
Eclipse UserFriend
Originally posted by: stepper.sympedia.de

Simon McDuff schrieb:
> Do you think we could stream the data. ?
>
> Use case:
> One of my attribute is Binary. I don't want to serialize it it all... it
> will take too much time. I want to read it as it stream.(The file could be 1
> gigs... 200 megs.. what whatever)
>
> I want to stream it so the consumer can read it as its stream....
>
> We could possibly send a CDOBinary.. and once the user read it.. open a
> stream between the server and the client.
>
> I don't think it should be very complicated.. isn't ?
>
Hmm, I don't have a clue what exactly you mean.
By "binary attribute" do you mean an EAttribute with an own EDataType?
How is a file related to this?

I fear you'll have to explain it in more detail.

Cheers
/Eike
Re: [CDO][0.8.0] Streaming [message #96333 is a reply to message #96318] Fri, 07 September 2007 15:49 Go to previous messageGo to next message
Simon Mc Duff is currently offline Simon Mc DuffFriend
Messages: 596
Registered: July 2009
Senior Member
"Eike Stepper" <stepper@sympedia.de> wrote in message
news:fbrpmr$jr7$1@build.eclipse.org...
> Simon McDuff schrieb:
>> Do you think we could stream the data. ?
>>
>> Use case:
>> One of my attribute is Binary. I don't want to serialize it it all... it
>> will take too much time. I want to read it as it stream.(The file could
>> be 1 gigs... 200 megs.. what whatever)
>>
>> I want to stream it so the consumer can read it as its stream....
>>
>> We could possibly send a CDOBinary.. and once the user read it.. open a
>> stream between the server and the client.
>>
>> I don't think it should be very complicated.. isn't ?
>>
> Hmm, I don't have a clue what exactly you mean.
> By "binary attribute" do you mean an EAttribute with an own EDataType?
> How is a file related to this?
>
> I fear you'll have to explain it in more detail.
>
> Cheers
> /Eike
>
>

Let say we have binary data that is really big on the server. (1 gigs of
data.. could be a file, or anything else...)
This binary is attached to the model somehow. (Could be
EcorePackage.Literals.EBYTE_ARRAY or Base64.)

How will you make it available to the consumer ?

The efficient way will be to stream the data...

What we need to do to achieve that ?
Re: [CDO][0.8.0] Streaming [message #96393 is a reply to message #96333] Mon, 10 September 2007 08:32 Go to previous message
Eclipse UserFriend
Originally posted by: stepper.sympedia.de

This is a multi-part message in MIME format.
--------------010800060502030909070502
Content-Type: text/plain; charset=ISO-8859-15; format=flowed
Content-Transfer-Encoding: 7bit

Simon,

If the data is "attached" to the model (at client side) through the use
of an EDataType it gets serialized to a String. Your (generated)
EPackage has control over the exact format. Although this might not be
the perfect way to handle huge amounts of binary data I don't see an
alternative if you insist on accessing it by EMF means.

Of course you could use plain Net4j to develop an own protocol that
optimizes the handling of huge data blocks / streams. But how would that
be connected to EMF / Ecore?

Cheers
/Eike


Simon McDuff schrieb:
> "Eike Stepper" <stepper@sympedia.de> wrote in message
> news:fbrpmr$jr7$1@build.eclipse.org...
>
>> Simon McDuff schrieb:
>>
>>> Do you think we could stream the data. ?
>>>
>>> Use case:
>>> One of my attribute is Binary. I don't want to serialize it it all... it
>>> will take too much time. I want to read it as it stream.(The file could
>>> be 1 gigs... 200 megs.. what whatever)
>>>
>>> I want to stream it so the consumer can read it as its stream....
>>>
>>> We could possibly send a CDOBinary.. and once the user read it.. open a
>>> stream between the server and the client.
>>>
>>> I don't think it should be very complicated.. isn't ?
>>>
>>>
>> Hmm, I don't have a clue what exactly you mean.
>> By "binary attribute" do you mean an EAttribute with an own EDataType?
>> How is a file related to this?
>>
>> I fear you'll have to explain it in more detail.
>>
>> Cheers
>> /Eike
>>
>>
>>
>
> Let say we have binary data that is really big on the server. (1 gigs of
> data.. could be a file, or anything else...)
> This binary is attached to the model somehow. (Could be
> EcorePackage.Literals.EBYTE_ARRAY or Base64.)
>
> How will you make it available to the consumer ?
>
> The efficient way will be to stream the data...
>
> What we need to do to achieve that ?
>
>
>
>
>

--------------010800060502030909070502
Content-Type: text/html; charset=ISO-8859-15
Content-Transfer-Encoding: 7bit

<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html;charset=ISO-8859-15"
http-equiv="Content-Type">
</head>
<body bgcolor="#ffffff" text="#000000">
Simon,<br>
<br>
If the data is "attached" to the model (at client side) through the use
of an EDataType it gets serialized to a String. Your (generated)
EPackage has control over the exact format. Although this might not be
the perfect way to handle huge amounts of binary data I don't see an
alternative if you insist on accessing it by EMF means.<br>
<br>
Of course you could use plain Net4j to develop an own protocol that
optimizes the handling of huge data blocks / streams. But how would
that be connected to EMF / Ecore?<br>
<br>
Cheers<br>
/Eike<br>
<br>
<br>
Simon McDuff schrieb:
<blockquote cite="mid:fbrrur$h1f$1@build.eclipse.org" type="cite">
<pre wrap="">"Eike Stepper" <a class="moz-txt-link-rfc2396E" href="mailto:stepper@sympedia.de">&lt;stepper@sympedia.de&gt;</a> wrote in message
<a class="moz-txt-link-freetext" href="news:fbrpmr$jr7$1@build.eclipse.org">news:fbrpmr$jr7$1@build.eclipse.org</a>...
</pre>
<blockquote type="cite">
<pre wrap="">Simon McDuff schrieb:
</pre>
<blockquote type="cite">
<pre wrap="">Do you think we could stream the data. ?

Use case:
One of my attribute is Binary. I don't want to serialize it it all... it
will take too much time. I want to read it as it stream.(The file could
be 1 gigs... 200 megs.. what whatever)

I want to stream it so the consumer can read it as its stream....

We could possibly send a CDOBinary.. and once the user read it.. open a
stream between the server and the client.

I don't think it should be very complicated.. isn't ?

</pre>
</blockquote>
<pre wrap="">Hmm, I don't have a clue what exactly you mean.
By "binary attribute" do you mean an EAttribute with an own EDataType?
How is a file related to this?

I fear you'll have to explain it in more detail.

Cheers
/Eike


</pre>
</blockquote>
<pre wrap=""><!---->
Let say we have binary data that is really big on the server. (1 gigs of
data.. could be a file, or anything else...)
This binary is attached to the model somehow. (Could be
EcorePackage.Literals.EBYTE_ARRAY or Base64.)

How will you make it available to the consumer ?

The efficient way will be to stream the data...

What we need to do to achieve that ?




</pre>
</blockquote>
</body>
</html>

--------------010800060502030909070502--
Re: [CDO][0.8.0] Streaming [message #609670 is a reply to message #96300] Fri, 07 September 2007 15:11 Go to previous message
Eike Stepper is currently offline Eike StepperFriend
Messages: 6690
Registered: July 2009
Senior Member
Simon McDuff schrieb:
> Do you think we could stream the data. ?
>
> Use case:
> One of my attribute is Binary. I don't want to serialize it it all... it
> will take too much time. I want to read it as it stream.(The file could be 1
> gigs... 200 megs.. what whatever)
>
> I want to stream it so the consumer can read it as its stream....
>
> We could possibly send a CDOBinary.. and once the user read it.. open a
> stream between the server and the client.
>
> I don't think it should be very complicated.. isn't ?
>
Hmm, I don't have a clue what exactly you mean.
By "binary attribute" do you mean an EAttribute with an own EDataType?
How is a file related to this?

I fear you'll have to explain it in more detail.

Cheers
/Eike


Re: [CDO][0.8.0] Streaming [message #609672 is a reply to message #96318] Fri, 07 September 2007 15:49 Go to previous message
Simon Mc Duff is currently offline Simon Mc DuffFriend
Messages: 596
Registered: July 2009
Senior Member
"Eike Stepper" <stepper@sympedia.de> wrote in message
news:fbrpmr$jr7$1@build.eclipse.org...
> Simon McDuff schrieb:
>> Do you think we could stream the data. ?
>>
>> Use case:
>> One of my attribute is Binary. I don't want to serialize it it all... it
>> will take too much time. I want to read it as it stream.(The file could
>> be 1 gigs... 200 megs.. what whatever)
>>
>> I want to stream it so the consumer can read it as its stream....
>>
>> We could possibly send a CDOBinary.. and once the user read it.. open a
>> stream between the server and the client.
>>
>> I don't think it should be very complicated.. isn't ?
>>
> Hmm, I don't have a clue what exactly you mean.
> By "binary attribute" do you mean an EAttribute with an own EDataType?
> How is a file related to this?
>
> I fear you'll have to explain it in more detail.
>
> Cheers
> /Eike
>
>

Let say we have binary data that is really big on the server. (1 gigs of
data.. could be a file, or anything else...)
This binary is attached to the model somehow. (Could be
EcorePackage.Literals.EBYTE_ARRAY or Base64.)

How will you make it available to the consumer ?

The efficient way will be to stream the data...

What we need to do to achieve that ?
Re: [CDO][0.8.0] Streaming [message #609683 is a reply to message #96333] Mon, 10 September 2007 08:32 Go to previous message
Eike Stepper is currently offline Eike StepperFriend
Messages: 6690
Registered: July 2009
Senior Member
This is a multi-part message in MIME format.
--------------010800060502030909070502
Content-Type: text/plain; charset=ISO-8859-15; format=flowed
Content-Transfer-Encoding: 7bit

Simon,

If the data is "attached" to the model (at client side) through the use
of an EDataType it gets serialized to a String. Your (generated)
EPackage has control over the exact format. Although this might not be
the perfect way to handle huge amounts of binary data I don't see an
alternative if you insist on accessing it by EMF means.

Of course you could use plain Net4j to develop an own protocol that
optimizes the handling of huge data blocks / streams. But how would that
be connected to EMF / Ecore?

Cheers
/Eike


Simon McDuff schrieb:
> "Eike Stepper" <stepper@sympedia.de> wrote in message
> news:fbrpmr$jr7$1@build.eclipse.org...
>
>> Simon McDuff schrieb:
>>
>>> Do you think we could stream the data. ?
>>>
>>> Use case:
>>> One of my attribute is Binary. I don't want to serialize it it all... it
>>> will take too much time. I want to read it as it stream.(The file could
>>> be 1 gigs... 200 megs.. what whatever)
>>>
>>> I want to stream it so the consumer can read it as its stream....
>>>
>>> We could possibly send a CDOBinary.. and once the user read it.. open a
>>> stream between the server and the client.
>>>
>>> I don't think it should be very complicated.. isn't ?
>>>
>>>
>> Hmm, I don't have a clue what exactly you mean.
>> By "binary attribute" do you mean an EAttribute with an own EDataType?
>> How is a file related to this?
>>
>> I fear you'll have to explain it in more detail.
>>
>> Cheers
>> /Eike
>>
>>
>>
>
> Let say we have binary data that is really big on the server. (1 gigs of
> data.. could be a file, or anything else...)
> This binary is attached to the model somehow. (Could be
> EcorePackage.Literals.EBYTE_ARRAY or Base64.)
>
> How will you make it available to the consumer ?
>
> The efficient way will be to stream the data...
>
> What we need to do to achieve that ?
>
>
>
>
>

--------------010800060502030909070502
Content-Type: text/html; charset=ISO-8859-15
Content-Transfer-Encoding: 7bit

<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html;charset=ISO-8859-15"
http-equiv="Content-Type">
</head>
<body bgcolor="#ffffff" text="#000000">
Simon,<br>
<br>
If the data is "attached" to the model (at client side) through the use
of an EDataType it gets serialized to a String. Your (generated)
EPackage has control over the exact format. Although this might not be
the perfect way to handle huge amounts of binary data I don't see an
alternative if you insist on accessing it by EMF means.<br>
<br>
Of course you could use plain Net4j to develop an own protocol that
optimizes the handling of huge data blocks / streams. But how would
that be connected to EMF / Ecore?<br>
<br>
Cheers<br>
/Eike<br>
<br>
<br>
Simon McDuff schrieb:
<blockquote cite="mid:fbrrur$h1f$1@build.eclipse.org" type="cite">
<pre wrap="">"Eike Stepper" <a class="moz-txt-link-rfc2396E" href="mailto:stepper@sympedia.de">&lt;stepper@sympedia.de&gt;</a> wrote in message
<a class="moz-txt-link-freetext" href="news:fbrpmr$jr7$1@build.eclipse.org">news:fbrpmr$jr7$1@build.eclipse.org</a>...
</pre>
<blockquote type="cite">
<pre wrap="">Simon McDuff schrieb:
</pre>
<blockquote type="cite">
<pre wrap="">Do you think we could stream the data. ?

Use case:
One of my attribute is Binary. I don't want to serialize it it all... it
will take too much time. I want to read it as it stream.(The file could
be 1 gigs... 200 megs.. what whatever)

I want to stream it so the consumer can read it as its stream....

We could possibly send a CDOBinary.. and once the user read it.. open a
stream between the server and the client.

I don't think it should be very complicated.. isn't ?

</pre>
</blockquote>
<pre wrap="">Hmm, I don't have a clue what exactly you mean.
By "binary attribute" do you mean an EAttribute with an own EDataType?
How is a file related to this?

I fear you'll have to explain it in more detail.

Cheers
/Eike


</pre>
</blockquote>
<pre wrap=""><!---->
Let say we have binary data that is really big on the server. (1 gigs of
data.. could be a file, or anything else...)
This binary is attached to the model somehow. (Could be
EcorePackage.Literals.EBYTE_ARRAY or Base64.)

How will you make it available to the consumer ?

The efficient way will be to stream the data...

What we need to do to achieve that ?




</pre>
</blockquote>
</body>
</html>

--------------010800060502030909070502--


Previous Topic:[CDO][0.8.0] Update
Next Topic:[Announce] Emfatic component proposal
Goto Forum:
  


Current Time: Wed Sep 25 04:14:59 GMT 2024

Powered by FUDForum. Page generated in 0.03552 seconds
.:: Contact :: Home ::.

Powered by: FUDforum 3.0.2.
Copyright ©2001-2010 FUDforum Bulletin Board Software

Back to the top