openssh unix dev - Feb 2001 - rsa_public_encrypt() exponent too small or not odd

I am attempting to deploy OpenSSH.

The trouble is I keep getting the rsa_public_encrypt() exponent too small or
not odd with the SSH 1 or 1.5 protocols. I can't get OpenSSH to communicate
with itself with any protocal other than SSH 2.


Platform notes:

HP-UX 11.00 Dart 51 64bit
OpenSSL 0.9.6
Zlib 1.1.3

Cflags:
-Ae


I have tried with and without optimizations. I noticed that this problem has
cropped up in the past on other platforms. But that was on much older
releases.


Anyone got any ideas?




Matthew Carlson

On Tue, 27 Feb 2001, CARLSON,MATTHEW (Non-HP-Cupertino,ex1) wrote:
: I am attempting to deploy OpenSSH.
:
: The trouble is I keep getting the rsa_public_encrypt() exponent too small or
: not odd with the SSH 1 or 1.5 protocols. I can't get OpenSSH to
communicate
: with itself with any protocal other than SSH 2.

i have never seen this on hp-ux 11.  what openssh version?  i would
guess it has to do with either your specific build or your
configuration.  does openssl pass make test?  can you try with a new
host key?

: Platform notes:
:
: HP-UX 11.00 Dart 51 64bit
: OpenSSL 0.9.6
: Zlib 1.1.3
:
: Cflags:
: -Ae

-Ae is the default for ansi cc on 11.

After a very late night I have some info for this.

I had installed openssl in an initial directory tree.

/opt/ims/include
/opt/ims/bin
/opt/ims/ssl

I then installed it in its own tree and deleted the initial trees.
/opt/ims/openssl/0.9.6

I forgot to delete
/opt/ims/include/openssl

Now I am not quite sure if there was a possible version overwrite of 0.9.6
on top of 0.9.5a in /opt/ims/include/openssl since 0.9.5a was installed in
there before.

After deleting the /opt/ims/include/openssl tree and just using
/opt/ims/openssl/0.9.6 then recompiling OpenSSH it worked fine.


If you could point out in the fact that rsa problems like this may be in
fact caused by the OpenSSL build or include files it would be very helpful.




Matthew Carlson


-----Original Message-----
From: Kevin Steves [mailto:stevesk at sweden.hp.com]
Sent: Thursday, March 01, 2001 9:37 AM
To: CARLSON,MATTHEW (Non-HP-Cupertino,ex1)
Cc: 'openssh-unix-dev at mindrot.org'
Subject: Re: rsa_public_encrypt() exponent too small or not odd


On Tue, 27 Feb 2001, CARLSON,MATTHEW (Non-HP-Cupertino,ex1) wrote:
: I am attempting to deploy OpenSSH.
:
: The trouble is I keep getting the rsa_public_encrypt() exponent too small
or
: not odd with the SSH 1 or 1.5 protocols. I can't get OpenSSH to
communicate
: with itself with any protocal other than SSH 2.

i have never seen this on hp-ux 11.  what openssh version?  i would
guess it has to do with either your specific build or your
configuration.  does openssl pass make test?  can you try with a new
host key?

: Platform notes:
:
: HP-UX 11.00 Dart 51 64bit
: OpenSSL 0.9.6
: Zlib 1.1.3
:
: Cflags:
: -Ae

-Ae is the default for ansi cc on 11.